Jul 27 13:06:04 devstack cinder-volume[76969]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 27 13:06:04 devstack cinder-volume[76969]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 27 13:06:04 devstack cinder-volume[76969]: we strongly recommend against using it for new projects. Jul 27 13:06:04 devstack cinder-volume[76969]: If you are already using Eventlet, we recommend migrating to a different Jul 27 13:06:04 devstack cinder-volume[76969]: framework. For more detail see Jul 27 13:06:04 devstack cinder-volume[76969]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 27 13:06:04 devstack cinder-volume[76969]: import eventlet # noqa Jul 27 13:06:07 devstack cinder-volume[76969]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:06:07 devstack cinder-volume[76969]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:06:07 devstack cinder-volume[76969]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:06:08 devstack cinder-volume[76969]: INFO dbcounter [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Registered counter for database cinder Jul 27 13:06:08 devstack cinder-volume[76969]: DEBUG oslo_db.sqlalchemy.engines [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG dbcounter [-] [76969] Writer thread running {{(pid=76969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.rpc [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.rpc [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_db.sqlalchemy.engines [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.volume.manager [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Determined volume DB was empty at startup. Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG cinder.volume.manager [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76969) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.volume.manager [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 27 13:06:09 devstack cinder-volume[76969]: WARNING stevedore.named [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 27 13:06:09 devstack cinder-volume[76969]: WARNING castellan.key_manager [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:06:09 devstack cinder-volume[76969]: WARNING cinder.keymgr.conf_key_mgr [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG cinder.volume.drivers.lvm [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76969) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_concurrency.processutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_concurrency.processutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] CMD "cinder-rtstool verify" returned: 0 in 0.461s {{(pid=76969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_db.sqlalchemy.engines [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.rpc [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.rpc [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 27 13:06:09 devstack cinder-volume[76969]: WARNING stevedore.named [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 27 13:06:09 devstack cinder-volume[76969]: WARNING castellan.key_manager [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:06:09 devstack cinder-volume[76969]: INFO cinder.volume.manager [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_db.sqlalchemy.engines [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:06:09 devstack cinder-volume[76969]: INFO oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Starting 1 workers Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Started child 77122 {{(pid=76969) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Full set of CONF: {{(pid=76969) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] ******************************************************************************** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Configuration options gathered from: {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] ================================================================================ {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] allow_availability_zone_fallback = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] allow_compression_on_image_upload = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] allowed_direct_url_schemes = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] api_rate_limit = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] auth_strategy = keystone {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] az_cache_duration = 3600 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_availability_zone = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_host = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_stats_polling_interval = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backup_api_class = cinder.backup.api.API {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backup_name_template = backup-%s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backup_use_same_host = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backup_use_temp_snapshot = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] chap_password = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] chap_username = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[77122]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_internal_tenant_project_id = 3b018aae5c8443889c9f906c96e9ace9 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_internal_tenant_user_id = d307fc1882b54c40b65f57456a9913d3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cloned_volume_same_az = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cluster = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] compression_format = gzip {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] compute_api_class = cinder.compute.nova.API {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] config_dir = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] config_source = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] control_exchange = openstack {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] debug = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] default_availability_zone = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] default_group_type = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] default_volume_type = lvmdriver-1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] disk_geometry = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] driver_client_cert = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] driver_client_cert_key = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] driver_data_namespace = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] driver_ssl_cert_path = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] driver_ssl_cert_verify = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] driver_use_ssl = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] enable_force_upload = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] enable_new_services = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] enable_unsupported_driver = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] enforce_multipath_for_image_xfer = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] filter_function = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_api_insecure = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_api_ssl_compression = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_ca_certificates_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_catalog_info = image:glance:publicURL {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_num_retries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance_request_timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] goodness_function = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] graceful_shutdown_timeout = 5 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] group_api_class = cinder.group.api.API {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] host = devstack {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_compress_on_upload = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_conversion_address_space_limit = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_conversion_cpu_limit = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_conversion_disable = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_upload_use_cinder_backend = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_upload_use_internal_tenant = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_volume_cache_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_volume_cache_max_count = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] image_volume_cache_max_size_gb = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] init_host_max_objects_retrieval = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] instance_format = [instance: %(uuid)s] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] iscsi_target_flags = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] iscsi_write_cache = on {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] iser_helper = tgtadm {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] iser_ip_address = 192.168.122.214 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] iser_port = 3260 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_color = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_config_append = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_dir = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_options = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_rotate_interval = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_rotate_interval_type = days {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] log_rotation_type = none {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] max_age = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] max_logfile_count = 30 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] max_logfile_size_mb = 200 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] max_over_subscription_ratio = 20.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] message_reap_interval = 86400 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] message_ttl = 2592000 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] migration_create_volume_timeout_secs = 300 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] monkey_patch = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] monkey_patch_modules = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] my_ip = 192.168.122.214 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] no_snapshot_gb_quota = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] num_iser_scan_tries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] num_shell_tries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] num_volume_device_scan_tries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] nvmeof_conn_info_version = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] nvmet_ns_id = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] nvmet_port_id = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_max_limit = 1000 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_volume_ext_list = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_volume_listen_port = 8776 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_volume_use_ssl = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] osapi_volume_workers = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] per_volume_size_limit = -1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] periodic_fuzzy_delay = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] periodic_interval = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] public_endpoint = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] publish_errors = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_backup_gigabytes = 1000 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_backups = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_gigabytes = 1000 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_groups = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_snapshots = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] quota_volumes = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] rate_limit_burst = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] rate_limit_except_level = CRITICAL {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] rate_limit_interval = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] reinit_driver_count = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] replication_device = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] report_discard_supported = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] report_interval = 120 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] reservation_clean_interval = 86400 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] reservation_expire = 86400 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] reserved_image_namespaces = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] reserved_percentage = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] rpc_response_timeout = 120 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] run_external_periodic_tasks = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] scst_target_driver = iscsi {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] scst_target_iqn_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_down_time = 720 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] shell_completion = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] snapshot_name_template = snapshot-%s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] snapshot_same_host = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] split_loggers = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] state_path = /opt/stack/data/cinder {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:09 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] storage_availability_zone = nova {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] storage_protocol = iSCSI {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] syslog_log_facility = LOG_USER {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] target_helper = lioadm {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] target_ip_address = 192.168.122.214 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] target_port = 3260 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] target_protocol = iscsi {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] target_secondary_ip_addresses = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] trace_flags = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] transport_url = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] until_refresh = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_chap_auth = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_default_quota_class = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_journal = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_json = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_multipath_for_image_xfer = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_stderr = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] use_syslog = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] verify_glance_signatures = enabled {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_api_class = cinder.volume.api.API {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_backend_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_clear = zero {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_clear_ionice = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_clear_size = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_copy_bps_limit = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_dd_blocksize = 1M {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_name_template = volume-%s {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_service_inithost_offload = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volume_usage_audit_period = month {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] zoning_mode = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_concurrency.disable_process_locking = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.auth_section = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.auth_type = password {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.auth_version = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.cache = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.include_service_catalog = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.insecure = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.interface = public {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_password = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcache_username = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.region_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.service_type = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.backend = dogpile.cache.null {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.backend_argument = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.backend_expiration_time = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.config_prefix = cache.oslo {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.debug_cache_backend = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.enable_retry_client = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.enable_socket_keepalive = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.expiration_time = 600 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.hashclient_retry_attempts = 2 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_dead_retry = 300 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_pool_maxsize = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_sasl_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.password = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.proxies = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.redis_db = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.redis_server = localhost:6379 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.retry_attempts = 2 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.retry_delay = 0.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.socket_keepalive_count = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.socket_keepalive_idle = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.socket_keepalive_interval = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.socket_timeout = 1.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.tls_allowed_ciphers = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.tls_cafile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.tls_certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.tls_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.tls_keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cache.username = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] coordination.backend_url = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.asyncio_connection = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.asyncio_slave_connection = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.backend = sqlalchemy {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.connection = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: INFO cinder.volume.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.connection_debug = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.connection_parameters = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.connection_recycle_time = 3600 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.connection_trace = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.db_inc_retry_interval = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.db_max_retries = 20 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.db_max_retry_interval = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.db_retry_interval = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.max_overflow = 50 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.max_pool_size = 5 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.max_retries = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.mysql_wsrep_sync_wait = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.pool_timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.retry_interval = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.slave_connection = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.sqlite_synchronous = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.synchronous_reader = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] database.use_db_reconnect = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.connection_string = messaging:// {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.es_doc_type = notification {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.es_scroll_size = 10000 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.es_scroll_time = 2m {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.filter_error_trace = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.hmac_keys = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.sentinel_service_name = mymaster {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.socket_timeout = 0.1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.trace_requests = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler.trace_sqlalchemy = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler_jaeger.process_tags = {} {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler_jaeger.service_name_prefix = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] profiler_otlp.service_name_prefix = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.enforce_new_defaults = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.policy_default_rule = default {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.policy_file = policy.yaml {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.group = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.helper_command = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] privsep_osbrick.user = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.group = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.helper_command = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] cinder_sys_admin.user = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.auth_section = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.auth_type = password {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.cafile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.collect_timing = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.insecure = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.send_service_user_token = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.split_loggers = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] service_user.timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.auth_section = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.auth_type = password {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.collect_timing = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.insecure = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.region_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.split_loggers = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] glance.timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.backend_availability_zone = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.chap_password = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.chap_username = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.disk_geometry = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.driver_client_cert = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.driver_client_cert_key = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.driver_data_namespace = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.driver_use_ssl = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.extra_capabilities = {} {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.filter_function = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.goodness_function = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.iscsi_target_flags = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.iscsi_write_cache = on {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.iser_helper = tgtadm {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.iser_port = 3260 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.lvm_share_target = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.lvm_type = auto {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.num_shell_tries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.replication_device = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.report_discard_supported = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.reserved_percentage = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.target_helper = tgtadm {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.target_port = 3260 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.target_protocol = iscsi {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.trace_flags = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.unique_fqdn_network = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.use_chap_auth = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_backend_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_clear = zero {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_clear_ionice = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_clear_size = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_reports.file_event_handler = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_reports.log_dir = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.backend_host = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.chap_password = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.chap_username = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.disk_geometry = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.driver_client_cert = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.extra_capabilities = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.filter_function = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.goodness_function = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.iser_helper = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.iser_ip_address = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.iser_port = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.lvm_share_target = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.lvm_type = auto {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.num_shell_tries = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.replication_device = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.report_discard_supported = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.reserved_percentage = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.scst_target_driver = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.storage_protocol = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.target_helper = lioadm {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.target_ip_address = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.target_port = 3260 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.trace_flags = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.use_chap_auth = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_clear = zero {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_clear_size = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] lvmdriver-1.volumes_dir = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_notifications.driver = [] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_notifications.retry = -1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] key_manager.fixed_key = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.barbican_api_version = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.barbican_endpoint = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.barbican_endpoint_type = public {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.barbican_region_name = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.cafile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.collect_timing = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.insecure = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.number_of_retries = 60 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.retry_delay = 1 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.send_service_user_token = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.split_loggers = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.verify_ssl = True {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican.verify_ssl_path = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.auth_section = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.auth_type = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.cafile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.certfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.collect_timing = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.insecure = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.keyfile = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.split_loggers = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] barbican_service_user.timeout = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.approle_role_id = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.approle_secret_id = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.auth_method = approle {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.auth_path = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.kv_mountpoint = secret {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.kv_path = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.kv_version = 2 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.namespace = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.root_token_id = **** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.ssl_ca_crt_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.timeout = 60.0 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.token_file = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.token_role = None {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.use_ssl = False {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:06:10 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] ******************************************************************************** {{(pid=76969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 27 13:06:10 devstack sudo[77168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 27 13:06:10 devstack sudo[77168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:10 devstack sudo[77168]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack sudo[77296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:10 devstack sudo[77296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:10 devstack sudo[77296]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.266s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:06:10 devstack cinder-volume[77122]: INFO cinder.brick.local_dev.lvm [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:10 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:10 devstack sudo[77387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:06:10 devstack sudo[77387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:11 devstack sudo[77387]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG cinder.brick.local_dev.lvm [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77122) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:11 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:11 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:11 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:11 devstack sudo[77658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:11 devstack sudo[77658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:11 devstack sudo[77658]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:11 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:11 devstack sudo[77737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 27 13:06:11 devstack sudo[77737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:12 devstack sudo[77737]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:12 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.350s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:12 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:12 devstack sudo[77820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:06:12 devstack sudo[77820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:12 devstack sudo[77820]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:12 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:12 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:12 devstack sudo[77823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:06:12 devstack sudo[77823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:12 devstack sudo[77823]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:12 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:12 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:12 devstack sudo[77866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:12 devstack sudo[77866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:13 devstack sudo[77866]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:13 devstack sudo[77915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:13 devstack sudo[77915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:13 devstack sudo[77915]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:13 devstack sudo[77919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:13 devstack sudo[77919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:13 devstack sudo[77919]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:13 devstack cinder-volume[77122]: INFO cinder.volume.drivers.lvm [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:13 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:13 devstack sudo[77923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:13 devstack sudo[77923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:14 devstack sudo[77923]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG cinder.volume.drivers.lvm [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Updating volume stats {{(pid=77122) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:14 devstack sudo[77926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:06:14 devstack sudo[77926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:14 devstack sudo[77926]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:14 devstack sudo[77935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:14 devstack sudo[77935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:14 devstack sudo[77935]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:14 devstack sudo[77938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:14 devstack sudo[77938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:14 devstack sudo[77938]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:14 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:14 devstack sudo[77941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:14 devstack sudo[77941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:15 devstack sudo[77941]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:15 devstack cinder-volume[77122]: INFO cinder.volume.driver [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Driver hasn't implemented _init_vendor_properties() Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG cinder.volume.driver [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77122) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_db.sqlalchemy.engines [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writer thread running {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG cinder.db.api [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Building query based on filter {{(pid=77122) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG cinder.image.image_utils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77122) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 27 13:06:15 devstack cinder-volume[77122]: INFO cinder.keymgr.migration [None req-60f59907-1845-42ca-a9a0-947cdad45e6b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG cinder.volume.drivers.lvm [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Updating volume stats {{(pid=77122) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:15 devstack sudo[77946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:06:15 devstack sudo[77946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:15 devstack sudo[77946]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:15 devstack sudo[77949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:15 devstack sudo[77949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:15 devstack sudo[77949]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:15 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:15 devstack sudo[77953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:15 devstack sudo[77953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:16 devstack sudo[77953]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:16 devstack sudo[77958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:16 devstack sudo[77958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:16 devstack sudo[77958]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG cinder.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Notifying Schedulers of capabilities ... {{(pid=77122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:06:16 devstack cinder-volume[77122]: INFO cinder.volume.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Driver initialization completed successfully. Jul 27 13:06:16 devstack cinder-volume[77122]: INFO cinder.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Initiating service 2 cleanup Jul 27 13:06:16 devstack cinder-volume[77122]: INFO cinder.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Service 2 cleanup completed. Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG cinder.service [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Creating RPC server for service cinder-volume {{(pid=77122) start /opt/stack/cinder/cinder/service.py:231}} Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG cinder.service [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77122) start /opt/stack/cinder/cinder/service.py:237}} Jul 27 13:06:16 devstack cinder-volume[77122]: INFO cinder.volume.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG cinder.volume.drivers.lvm [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Updating volume stats {{(pid=77122) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:16 devstack sudo[77961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:06:16 devstack sudo[77961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:16 devstack sudo[77961]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:16 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:16 devstack sudo[77964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:16 devstack sudo[77964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:17 devstack sudo[77964]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:17 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:17 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:17 devstack sudo[77967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:06:17 devstack sudo[77967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:17 devstack sudo[77967]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:17 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:17 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:06:17 devstack sudo[77971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:06:17 devstack sudo[77971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:06:17 devstack sudo[77971]: pam_unix(sudo:session): session closed for user root Jul 27 13:06:17 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:06:17 devstack cinder-volume[77122]: INFO cinder.volume.manager [None req-40c1ed09-d37c-4da8-be35-29deefc3239a None None] Driver post RPC initialization completed successfully. Jul 27 13:06:19 devstack cinder-volume[76969]: DEBUG dbcounter [-] [76969] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:06:27 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writing DB stats cinder:SELECT=3 {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:06:27 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:07:07 devstack cinder-volume[77122]: DEBUG oslo_service.periodic_task [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running periodic task VolumeManager._thread_info {{(pid=77122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:07:07 devstack cinder-volume[77122]: DEBUG cinder.volume.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] thread count: 6 {{(pid=77122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:07:07 devstack cinder-volume[77122]: DEBUG cinder.volume.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] thread info: [<_MainThread(MainThread, started 123602107199616)>, , , , , ] {{(pid=77122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:08:07 devstack cinder-volume[77122]: DEBUG oslo_service.periodic_task [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:08:07 devstack cinder-volume[77122]: DEBUG cinder.volume.drivers.lvm [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Updating volume stats {{(pid=77122) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 27 13:08:07 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:08:07 devstack sudo[83201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:08:07 devstack sudo[83201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:08:08 devstack sudo[83201]: pam_unix(sudo:session): session closed for user root Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:08:08 devstack sudo[83204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:08:08 devstack sudo[83204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:08:08 devstack sudo[83204]: pam_unix(sudo:session): session closed for user root Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:08:08 devstack sudo[83207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:08:08 devstack sudo[83207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:08:08 devstack sudo[83207]: pam_unix(sudo:session): session closed for user root Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:08:08 devstack sudo[83210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:08:08 devstack sudo[83210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:08:08 devstack sudo[83210]: pam_unix(sudo:session): session closed for user root Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG cinder.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Notifying Schedulers of capabilities ... {{(pid=77122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG oslo_service.periodic_task [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running periodic task VolumeManager._thread_info {{(pid=77122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG cinder.volume.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] thread count: 6 {{(pid=77122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:08:08 devstack cinder-volume[77122]: DEBUG cinder.volume.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] thread info: [<_MainThread(MainThread, started 123602107199616)>, , , , , ] {{(pid=77122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:08:27 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writing DB stats cinder:SELECT=1 {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:08:27 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writing DB stats cinder:UPDATE=1 {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:09:07 devstack cinder-volume[77122]: DEBUG oslo_service.periodic_task [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:09:07 devstack cinder-volume[77122]: DEBUG cinder.volume.drivers.lvm [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Updating volume stats {{(pid=77122) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 27 13:09:07 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:09:07 devstack sudo[85034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:09:07 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:09:08 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:09:08 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:09:08 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:09:08 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:09:08 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:09:08 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:09:08 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:09:08 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:09:08 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:09:08 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:09:08 devstack cinder-volume[77122]: DEBUG cinder.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Notifying Schedulers of capabilities ... {{(pid=77122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:10:07 devstack cinder-volume[77122]: DEBUG oslo_service.periodic_task [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:10:07 devstack cinder-volume[77122]: DEBUG cinder.volume.drivers.lvm [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Updating volume stats {{(pid=77122) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 27 13:10:07 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:07 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 27 13:10:07 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:08 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:08 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:10:08 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:08 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:08 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 27 13:10:08 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:08 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:08 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 27 13:10:08 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:08 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_concurrency.processutils [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG cinder.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Notifying Schedulers of capabilities ... {{(pid=77122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG oslo_service.periodic_task [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] Running periodic task VolumeManager._thread_info {{(pid=77122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG cinder.volume.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] thread count: 6 {{(pid=77122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:10:08 devstack cinder-volume[77122]: DEBUG cinder.volume.manager [None req-9aa9c771-266c-4d83-9077-42b31c210705 None None] thread info: [<_MainThread(MainThread, started 123602107199616)>, , , , , ] {{(pid=77122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:10:27 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writing DB stats cinder:SELECT=1 {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:10:27 devstack cinder-volume[77122]: DEBUG dbcounter [-] [77122] Writing DB stats cinder:UPDATE=1 {{(pid=77122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:10:46 devstack cinder-volume[76969]: INFO oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Caught SIGTERM, stopping children Jul 27 13:10:46 devstack cinder-volume[76969]: DEBUG oslo_concurrency.lockutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Acquiring lock "singleton_lock" {{(pid=76969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:10:46 devstack cinder-volume[76969]: DEBUG oslo_concurrency.lockutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Acquired lock "singleton_lock" {{(pid=76969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:10:46 devstack cinder-volume[76969]: DEBUG oslo_concurrency.lockutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Releasing lock "singleton_lock" {{(pid=76969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:10:46 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Stop services. {{(pid=76969) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 27 13:10:46 devstack cinder-volume[76969]: DEBUG oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Killing children. {{(pid=76969) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 27 13:10:46 devstack cinder-volume[76969]: INFO oslo_service.backend._eventlet.service [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Waiting on 1 children to exit Jul 27 13:10:51 devstack cinder-volume[77122]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 27 13:10:51 devstack cinder-volume[77122]: DEBUG oslo_concurrency.lockutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Acquiring lock "singleton_lock" {{(pid=77122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:10:51 devstack cinder-volume[77122]: DEBUG oslo_concurrency.lockutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Acquired lock "singleton_lock" {{(pid=77122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:10:51 devstack cinder-volume[77122]: DEBUG oslo_concurrency.lockutils [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Releasing lock "singleton_lock" {{(pid=77122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:10:51 devstack cinder-volume[77122]: WARNING amqp [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 27 13:10:51 devstack cinder-volume[77122]: WARNING amqp [None req-b5a2d7a1-5f2a-494c-8ecb-8a1a75072039 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 27 13:10:51 devstack cinder-volume[87232]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 27 13:10:51 devstack cinder-volume[87232]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 27 13:10:51 devstack cinder-volume[87232]: we strongly recommend against using it for new projects. Jul 27 13:10:51 devstack cinder-volume[87232]: If you are already using Eventlet, we recommend migrating to a different Jul 27 13:10:51 devstack cinder-volume[87232]: framework. For more detail see Jul 27 13:10:51 devstack cinder-volume[87232]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 27 13:10:51 devstack cinder-volume[87232]: import eventlet # noqa Jul 27 13:10:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:10:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:10:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:10:54 devstack cinder-volume[87232]: INFO dbcounter [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Registered counter for database cinder Jul 27 13:10:54 devstack cinder-volume[87232]: DEBUG oslo_db.sqlalchemy.engines [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writer thread running {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 27 13:10:55 devstack cinder-volume[87232]: INFO cinder.rpc [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 27 13:10:55 devstack cinder-volume[87232]: INFO cinder.rpc [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_db.sqlalchemy.engines [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:10:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Determined volume DB was empty at startup. Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87232) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 27 13:10:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 27 13:10:55 devstack cinder-volume[87232]: WARNING stevedore.named [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 27 13:10:55 devstack cinder-volume[87232]: WARNING castellan.key_manager [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:10:55 devstack cinder-volume[87232]: WARNING cinder.keymgr.conf_key_mgr [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:10:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_db.sqlalchemy.engines [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:10:55 devstack cinder-volume[87232]: INFO oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Starting 1 workers Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Started child 87482 {{(pid=87232) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Full set of CONF: {{(pid=87232) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] ******************************************************************************** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Configuration options gathered from: {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] ================================================================================ {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] allow_availability_zone_fallback = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] allow_compression_on_image_upload = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] allowed_direct_url_schemes = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87482]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] api_rate_limit = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] auth_strategy = keystone {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_availability_zone = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_host = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_stats_polling_interval = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backup_api_class = cinder.backup.api.API {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backup_name_template = backup-%s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backup_use_same_host = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backup_use_temp_snapshot = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] chap_password = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] chap_username = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_internal_tenant_project_id = 3b018aae5c8443889c9f906c96e9ace9 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_internal_tenant_user_id = d307fc1882b54c40b65f57456a9913d3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cluster = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] compression_format = gzip {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] compute_api_class = cinder.compute.nova.API {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] config_dir = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] config_source = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] control_exchange = openstack {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] debug = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] default_availability_zone = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] default_group_type = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] default_volume_type = QuobyteHD {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] disk_geometry = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] driver_client_cert = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] driver_client_cert_key = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] driver_data_namespace = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] driver_ssl_cert_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] driver_ssl_cert_verify = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] driver_use_ssl = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] enable_new_services = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] enable_unsupported_driver = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] enabled_backends = ['QuobyteHD'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] enforce_multipath_for_image_xfer = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] filter_function = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_api_insecure = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_api_ssl_compression = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_ca_certificates_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_catalog_info = image:glance:publicURL {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_num_retries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance_request_timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] goodness_function = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] graceful_shutdown_timeout = 5 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] group_api_class = cinder.group.api.API {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] host = devstack {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_compress_on_upload = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_conversion_address_space_limit = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_conversion_cpu_limit = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_conversion_disable = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_upload_use_cinder_backend = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_upload_use_internal_tenant = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_volume_cache_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_volume_cache_max_count = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] image_volume_cache_max_size_gb = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] init_host_max_objects_retrieval = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] instance_format = [instance: %(uuid)s] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] iscsi_target_flags = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] iscsi_write_cache = on {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] iser_helper = tgtadm {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] iser_ip_address = 192.168.122.214 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] iser_port = 3260 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_color = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_config_append = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_dir = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_options = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_rotate_interval = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_rotate_interval_type = days {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] log_rotation_type = none {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] max_age = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] max_logfile_count = 30 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] max_logfile_size_mb = 200 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] max_over_subscription_ratio = 20.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] message_reap_interval = 86400 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] message_ttl = 2592000 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] migration_create_volume_timeout_secs = 300 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] monkey_patch = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] monkey_patch_modules = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] my_ip = 192.168.122.214 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] no_snapshot_gb_quota = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] num_iser_scan_tries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] num_shell_tries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] num_volume_device_scan_tries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] nvmeof_conn_info_version = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] nvmet_ns_id = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] nvmet_port_id = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_max_limit = 1000 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_volume_ext_list = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_volume_listen_port = 8776 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_volume_use_ssl = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] osapi_volume_workers = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] per_volume_size_limit = -1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] periodic_fuzzy_delay = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] periodic_interval = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] public_endpoint = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] publish_errors = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_backup_gigabytes = 1000 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_backups = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_gigabytes = 1000 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_groups = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_snapshots = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] quota_volumes = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] rate_limit_burst = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] rate_limit_except_level = CRITICAL {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] rate_limit_interval = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] reinit_driver_count = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] replication_device = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] report_discard_supported = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] report_interval = 120 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] reservation_clean_interval = 86400 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] reservation_expire = 86400 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] reserved_image_namespaces = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] reserved_percentage = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Starting volume driver QuobyteDriver (1.2) Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] rpc_response_timeout = 120 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] run_external_periodic_tasks = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] scst_target_driver = iscsi {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] scst_target_iqn_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_down_time = 720 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] shell_completion = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] snapshot_name_template = snapshot-%s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] split_loggers = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] state_path = /opt/stack/data/cinder {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] storage_availability_zone = nova {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] storage_protocol = iSCSI {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] syslog_log_facility = LOG_USER {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] target_helper = lioadm {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] target_ip_address = 192.168.122.214 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] target_port = 3260 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.remotefs [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87482) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] target_protocol = iscsi {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] target_secondary_ip_addresses = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] trace_flags = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] transport_url = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] until_refresh = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_chap_auth = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_default_quota_class = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_journal = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_json = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_multipath_for_image_xfer = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_stderr = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] use_syslog = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] verify_glance_signatures = enabled {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_api_class = cinder.volume.api.API {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_backend_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_clear = zero {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_clear_ionice = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_clear_size = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_copy_bps_limit = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_dd_blocksize = 1M {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_name_template = volume-%s {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_service_inithost_offload = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volume_usage_audit_period = month {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] zoning_mode = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_concurrency.disable_process_locking = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.auth_section = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.auth_type = password {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.auth_version = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.cache = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.include_service_catalog = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.insecure = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.interface = public {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_password = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcache_username = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.region_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.service_type = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.backend = dogpile.cache.null {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.backend_argument = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.backend_expiration_time = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.config_prefix = cache.oslo {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.debug_cache_backend = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.enable_retry_client = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.enable_socket_keepalive = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.expiration_time = 600 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.hashclient_retry_attempts = 2 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_dead_retry = 300 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_pool_maxsize = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_sasl_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.password = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.proxies = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.redis_db = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.redis_server = localhost:6379 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.retry_attempts = 2 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.retry_delay = 0.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.socket_keepalive_count = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.socket_keepalive_idle = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.socket_keepalive_interval = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.socket_timeout = 1.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.tls_allowed_ciphers = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.tls_cafile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.tls_certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.tls_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.tls_keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cache.username = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] coordination.backend_url = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.asyncio_connection = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.asyncio_slave_connection = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.backend = sqlalchemy {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.connection = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.connection_debug = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.connection_parameters = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.connection_recycle_time = 3600 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.connection_trace = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.db_inc_retry_interval = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.db_max_retries = 20 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.db_max_retry_interval = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.db_retry_interval = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.max_overflow = 50 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.max_pool_size = 5 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.max_retries = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.mysql_wsrep_sync_wait = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.pool_timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.retry_interval = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.slave_connection = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.sqlite_synchronous = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.synchronous_reader = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] database.use_db_reconnect = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.connection_string = messaging:// {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.es_doc_type = notification {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.es_scroll_size = 10000 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.es_scroll_time = 2m {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.filter_error_trace = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.hmac_keys = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.sentinel_service_name = mymaster {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.socket_timeout = 0.1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.trace_requests = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler.trace_sqlalchemy = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler_jaeger.process_tags = {} {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler_jaeger.service_name_prefix = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] profiler_otlp.service_name_prefix = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.enforce_new_defaults = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.policy_default_rule = default {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.policy_file = policy.yaml {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.group = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.helper_command = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] privsep_osbrick.user = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.group = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87482) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 27 13:10:55 devstack cinder-volume[87482]: WARNING cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 27 13:10:55 devstack cinder-volume[87482]: WARNING cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Running cmd (subprocess): mount.quobyte {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.helper_command = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] cinder_sys_admin.user = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.auth_section = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.auth_type = password {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.cafile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.collect_timing = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.insecure = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.send_service_user_token = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.split_loggers = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] service_user.timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.auth_section = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.auth_type = password {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.collect_timing = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.insecure = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.region_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.split_loggers = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] glance.timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.backend_availability_zone = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.chap_password = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.chap_username = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.disk_geometry = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.driver_client_cert = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.driver_client_cert_key = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.driver_data_namespace = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.driver_use_ssl = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.extra_capabilities = {} {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.filter_function = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.goodness_function = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.iscsi_target_flags = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.iscsi_write_cache = on {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.iser_helper = tgtadm {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.iser_port = 3260 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_host = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_login = admin {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_mount_options = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_password = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_private_key = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_share_path = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.num_shell_tries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.quobyte_volume_url = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.replication_device = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.report_discard_supported = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.reserved_percentage = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.target_helper = tgtadm {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.target_port = 3260 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.target_protocol = iscsi {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.trace_flags = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.unique_fqdn_network = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.use_chap_auth = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_backend_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_clear = zero {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_clear_ionice = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_clear_size = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_reports.file_event_handler = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_reports.log_dir = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.backend_availability_zone = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.backend_host = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.chap_password = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.chap_username = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.chiscsi_conf = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.disk_geometry = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.driver_client_cert = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.driver_data_namespace = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.driver_use_ssl = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.extra_capabilities = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.filter_function = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.goodness_function = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.iser_helper = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.iser_ip_address = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.iser_port = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.iser_target_prefix = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_host = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_login = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_mount_options = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_password = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_private_key = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_share_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_ssh_port = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.num_shell_tries = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.nvmet_port_id = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.replication_device = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.report_discard_supported = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.reserved_percentage = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.scst_target_driver = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.storage_protocol = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.target_helper = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.target_ip_address = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.target_port = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.target_prefix = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.target_protocol = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.trace_flags = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.use_chap_auth = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_clear = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_clear_size = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] QuobyteHD.volumes_dir = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_notifications.driver = [] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_notifications.retry = -1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87482]: INFO cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 ... Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 -c /etc/quobyte/client-cinder.cfg {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] key_manager.fixed_key = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.barbican_api_version = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.barbican_endpoint = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.barbican_endpoint_type = public {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.barbican_region_name = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.cafile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.collect_timing = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.insecure = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.number_of_retries = 60 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.retry_delay = 1 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.send_service_user_token = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.split_loggers = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.verify_ssl = True {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican.verify_ssl_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.auth_section = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.auth_type = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.cafile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.certfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.collect_timing = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.insecure = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.keyfile = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.split_loggers = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] barbican_service_user.timeout = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.approle_role_id = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.approle_secret_id = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.auth_method = approle {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.auth_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.kv_mountpoint = secret {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.kv_path = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.kv_version = 2 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.namespace = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.root_token_id = **** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.ssl_ca_crt_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.timeout = 60.0 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.token_file = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.token_role = None {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.use_ssl = False {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:10:55 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] ******************************************************************************** {{(pid=87232) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 27 13:10:55 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 -c /etc/quobyte/client-cinder.cfg Jul 27 13:10:55 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:56 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.414s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:56 devstack cinder-volume[87482]: INFO cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 succeeded Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.427s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:56 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:10:56 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:56 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.288s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:56 devstack cinder-volume[87482]: INFO cinder.volume.driver [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Driver hasn't implemented _init_vendor_properties() Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.volume.driver [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87482) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87482) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG dbcounter [-] [87482] Writer thread running {{(pid=87482) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.db.api [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Building query based on filter {{(pid=87482) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.image.image_utils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87482) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 27 13:10:56 devstack cinder-volume[87482]: INFO cinder.keymgr.migration [None req-66980612-7d8d-41be-bdaf-2a1660fb8185 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:56 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:10:56 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:56 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.252s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Notifying Schedulers of capabilities ... {{(pid=87482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:10:56 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Driver initialization completed successfully. Jul 27 13:10:56 devstack cinder-volume[87482]: INFO cinder.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Initiating service 3 cleanup Jul 27 13:10:56 devstack cinder-volume[87482]: INFO cinder.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Service 3 cleanup completed. Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.service [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Creating RPC server for service cinder-volume {{(pid=87482) start /opt/stack/cinder/cinder/service.py:231}} Jul 27 13:10:56 devstack cinder-volume[87482]: DEBUG cinder.service [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87482) start /opt/stack/cinder/cinder/service.py:237}} Jul 27 13:10:57 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:10:57 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:10:57 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:10:57 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Jul 27 13:10:57 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.270s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:10:57 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-9cf9b612-0aec-48e5-adf5-f31b72a2881a None None] Driver post RPC initialization completed successfully. Jul 27 13:11:01 devstack cinder-volume[87232]: INFO oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Caught SIGTERM, stopping children Jul 27 13:11:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Acquiring lock "singleton_lock" {{(pid=87232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:11:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Acquired lock "singleton_lock" {{(pid=87232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:11:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Releasing lock "singleton_lock" {{(pid=87232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:11:01 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Stop services. {{(pid=87232) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 27 13:11:01 devstack cinder-volume[87232]: DEBUG oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Killing children. {{(pid=87232) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 27 13:11:01 devstack cinder-volume[87232]: INFO oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Waiting on 1 children to exit Jul 27 13:11:05 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Acquiring lock "singleton_lock" {{(pid=87482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:11:05 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Acquired lock "singleton_lock" {{(pid=87482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:11:05 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Releasing lock "singleton_lock" {{(pid=87482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:11:05 devstack cinder-volume[87482]: WARNING amqp [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 27 13:11:05 devstack cinder-volume[87482]: WARNING amqp [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 27 13:11:05 devstack cinder-volume[87232]: INFO oslo_service.backend._eventlet.service [None req-732f735d-4109-4b76-ab1f-893608b02ef9 None None] Child 87482 exited with status 0 Jul 27 13:11:06 devstack cinder-volume[87921]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 27 13:11:06 devstack cinder-volume[87921]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 27 13:11:06 devstack cinder-volume[87921]: we strongly recommend against using it for new projects. Jul 27 13:11:06 devstack cinder-volume[87921]: If you are already using Eventlet, we recommend migrating to a different Jul 27 13:11:06 devstack cinder-volume[87921]: framework. For more detail see Jul 27 13:11:06 devstack cinder-volume[87921]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 27 13:11:06 devstack cinder-volume[87921]: import eventlet # noqa Jul 27 13:11:09 devstack cinder-volume[87921]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87921) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 27 13:11:09 devstack cinder-volume[87921]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87921) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 27 13:11:09 devstack cinder-volume[87921]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87921) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 27 13:11:10 devstack cinder-volume[87921]: INFO dbcounter [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Registered counter for database cinder Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_db.sqlalchemy.engines [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87921) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG dbcounter [-] [87921] Writer thread running {{(pid=87921) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 27 13:11:10 devstack cinder-volume[87921]: INFO cinder.rpc [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 27 13:11:10 devstack cinder-volume[87921]: INFO cinder.rpc [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_db.sqlalchemy.engines [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87921) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:11:10 devstack cinder-volume[87921]: INFO cinder.volume.manager [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Determined volume DB was empty at startup. Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG cinder.volume.manager [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87921) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 27 13:11:10 devstack cinder-volume[87921]: WARNING stevedore.named [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 27 13:11:10 devstack cinder-volume[87921]: WARNING castellan.key_manager [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:11:10 devstack cinder-volume[87921]: WARNING cinder.keymgr.conf_key_mgr [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 27 13:11:10 devstack cinder-volume[87921]: INFO cinder.volume.manager [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_db.sqlalchemy.engines [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87921) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:11:10 devstack cinder-volume[87921]: INFO oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Starting 1 workers Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Started child 88202 {{(pid=87921) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Full set of CONF: {{(pid=87921) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] ******************************************************************************** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] Configuration options gathered from: {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 27 13:11:10 devstack cinder-volume[88202]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] ================================================================================ {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] allow_availability_zone_fallback = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] allow_compression_on_image_upload = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] allowed_direct_url_schemes = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] api_rate_limit = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] auth_strategy = keystone {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_availability_zone = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_host = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_stats_polling_interval = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backup_api_class = cinder.backup.api.API {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backup_name_template = backup-%s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backup_use_same_host = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backup_use_temp_snapshot = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] chap_password = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] chap_username = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_internal_tenant_project_id = 3b018aae5c8443889c9f906c96e9ace9 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_internal_tenant_user_id = d307fc1882b54c40b65f57456a9913d3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cluster = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] compression_format = gzip {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] compute_api_class = cinder.compute.nova.API {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] config_dir = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] config_source = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] control_exchange = openstack {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] debug = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] default_availability_zone = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] default_group_type = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] default_volume_type = QuobyteHD {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] disk_geometry = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] driver_client_cert = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] driver_client_cert_key = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] driver_data_namespace = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] driver_ssl_cert_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] driver_ssl_cert_verify = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] driver_use_ssl = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] enable_new_services = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] enable_unsupported_driver = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] enabled_backends = ['QuobyteHD'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] enforce_multipath_for_image_xfer = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] filter_function = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_api_insecure = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_api_ssl_compression = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_ca_certificates_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_catalog_info = image:glance:publicURL {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_num_retries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance_request_timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] goodness_function = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] graceful_shutdown_timeout = 5 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] group_api_class = cinder.group.api.API {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] host = devstack {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_compress_on_upload = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_conversion_address_space_limit = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_conversion_cpu_limit = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_conversion_disable = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_upload_use_cinder_backend = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_upload_use_internal_tenant = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_volume_cache_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_volume_cache_max_count = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] image_volume_cache_max_size_gb = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] init_host_max_objects_retrieval = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] instance_format = [instance: %(uuid)s] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] iscsi_target_flags = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] iscsi_write_cache = on {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] iser_helper = tgtadm {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] iser_ip_address = 192.168.122.214 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] iser_port = 3260 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_color = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_config_append = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_dir = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_options = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_rotate_interval = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_rotate_interval_type = days {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] log_rotation_type = none {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] max_age = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] max_logfile_count = 30 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] max_logfile_size_mb = 200 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] max_over_subscription_ratio = 20.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] message_reap_interval = 86400 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] message_ttl = 2592000 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Starting volume driver QuobyteDriver (1.2) Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] migration_create_volume_timeout_secs = 300 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] monkey_patch = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] monkey_patch_modules = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] my_ip = 192.168.122.214 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] no_snapshot_gb_quota = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] num_iser_scan_tries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] num_shell_tries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] num_volume_device_scan_tries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] nvmeof_conn_info_version = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] nvmet_ns_id = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] nvmet_port_id = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_max_limit = 1000 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_volume_ext_list = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88202) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_volume_listen_port = 8776 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_volume_use_ssl = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] osapi_volume_workers = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] per_volume_size_limit = -1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] periodic_fuzzy_delay = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] periodic_interval = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] public_endpoint = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] publish_errors = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_backup_gigabytes = 1000 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_backups = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_gigabytes = 1000 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_groups = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_snapshots = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] quota_volumes = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] rate_limit_burst = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] rate_limit_except_level = CRITICAL {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] rate_limit_interval = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] reinit_driver_count = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] replication_device = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] report_discard_supported = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] report_interval = 120 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] reservation_clean_interval = 86400 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] reservation_expire = 86400 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] reserved_image_namespaces = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] reserved_percentage = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] rpc_response_timeout = 120 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] run_external_periodic_tasks = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] scst_target_driver = iscsi {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] scst_target_iqn_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_down_time = 720 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] shell_completion = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] snapshot_name_template = snapshot-%s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:10 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] split_loggers = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] state_path = /opt/stack/data/cinder {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] storage_availability_zone = nova {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] storage_protocol = iSCSI {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] syslog_log_facility = LOG_USER {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] target_helper = lioadm {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] target_ip_address = 192.168.122.214 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] target_port = 3260 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] target_protocol = iscsi {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] target_secondary_ip_addresses = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] trace_flags = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] transport_url = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] until_refresh = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_chap_auth = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_default_quota_class = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_journal = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_json = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_multipath_for_image_xfer = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_stderr = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] use_syslog = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] verify_glance_signatures = enabled {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_api_class = cinder.volume.api.API {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_backend_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_clear = zero {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_clear_ionice = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_clear_size = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_copy_bps_limit = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_dd_blocksize = 1M {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_name_template = volume-%s {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_service_inithost_offload = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volume_usage_audit_period = month {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] zoning_mode = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_concurrency.disable_process_locking = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.auth_section = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.auth_type = password {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.auth_version = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.cache = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.include_service_catalog = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.insecure = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.interface = public {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_password = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcache_username = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.region_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.service_type = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.backend = dogpile.cache.null {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.backend_argument = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.backend_expiration_time = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.config_prefix = cache.oslo {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.debug_cache_backend = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.enable_retry_client = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.enable_socket_keepalive = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.expiration_time = 600 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.hashclient_retry_attempts = 2 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_dead_retry = 300 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_pool_maxsize = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_sasl_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.password = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.proxies = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.redis_db = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.redis_server = localhost:6379 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.retry_attempts = 2 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.retry_delay = 0.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.socket_keepalive_count = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.socket_keepalive_idle = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88202) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 27 13:11:11 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.socket_keepalive_interval = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.socket_timeout = 1.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.tls_allowed_ciphers = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.tls_cafile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.tls_certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.tls_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.tls_keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Running cmd (subprocess): mount.quobyte {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cache.username = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] coordination.backend_url = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.asyncio_connection = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.asyncio_slave_connection = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.backend = sqlalchemy {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.connection = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.connection_debug = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.connection_parameters = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.connection_recycle_time = 3600 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.connection_trace = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.db_inc_retry_interval = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.db_max_retries = 20 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.db_max_retry_interval = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.db_retry_interval = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.max_overflow = 50 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.max_pool_size = 5 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.max_retries = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.mysql_wsrep_sync_wait = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.pool_timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.retry_interval = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.slave_connection = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.sqlite_synchronous = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.synchronous_reader = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] database.use_db_reconnect = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.connection_string = messaging:// {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.es_doc_type = notification {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.es_scroll_size = 10000 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.es_scroll_time = 2m {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.filter_error_trace = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.hmac_keys = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.sentinel_service_name = mymaster {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.socket_timeout = 0.1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.trace_requests = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler.trace_sqlalchemy = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler_jaeger.process_tags = {} {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler_jaeger.service_name_prefix = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] profiler_otlp.service_name_prefix = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.enforce_new_defaults = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.policy_default_rule = default {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.policy_file = policy.yaml {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.group = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.helper_command = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] privsep_osbrick.user = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.group = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.helper_command = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] cinder_sys_admin.user = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.auth_section = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.auth_type = password {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.cafile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.collect_timing = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.insecure = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.send_service_user_token = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.split_loggers = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] service_user.timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.auth_section = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.auth_type = password {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.collect_timing = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.insecure = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.region_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.split_loggers = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] glance.timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.backend_availability_zone = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.chap_password = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.chap_username = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.disk_geometry = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.driver_client_cert = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.driver_client_cert_key = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.driver_data_namespace = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.driver_use_ssl = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.extra_capabilities = {} {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.filter_function = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.goodness_function = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.iscsi_target_flags = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.iscsi_write_cache = on {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.iser_helper = tgtadm {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.iser_port = 3260 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_host = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_login = admin {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_mount_options = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_password = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_private_key = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_share_path = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.num_shell_tries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack quobyte-client[88203]: Reading configuration file: /etc/quobyte/client.cfg Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack quobyte-client[88203]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.quobyte_volume_url = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.replication_device = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.report_discard_supported = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] CMD "mount.quobyte" returned: 1 in 0.052s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.reserved_percentage = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.target_helper = tgtadm {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.target_port = 3260 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.target_protocol = iscsi {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.trace_flags = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.unique_fqdn_network = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.use_chap_auth = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_backend_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_clear = zero {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_clear_ionice = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_clear_size = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_reports.file_event_handler = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_reports.log_dir = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.backend_availability_zone = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.backend_host = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.chap_password = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.chap_username = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.chiscsi_conf = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.disk_geometry = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.driver_client_cert = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.driver_data_namespace = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.driver_use_ssl = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.extra_capabilities = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.filter_function = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.goodness_function = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.iser_helper = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.iser_ip_address = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.iser_port = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.iser_target_prefix = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_host = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_login = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_mount_options = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_password = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_private_key = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_share_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_ssh_port = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.num_shell_tries = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.nvmet_port_id = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.replication_device = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.report_discard_supported = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.reserved_percentage = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.scst_target_driver = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.storage_protocol = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.target_helper = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.target_ip_address = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.target_port = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.target_prefix = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.target_protocol = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.trace_flags = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.use_chap_auth = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_clear = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_clear_size = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] QuobyteHD.volumes_dir = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_notifications.driver = [] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_notifications.retry = -1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] key_manager.fixed_key = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.barbican_api_version = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.barbican_endpoint = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.barbican_endpoint_type = public {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.barbican_region_name = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.cafile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.collect_timing = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.insecure = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.number_of_retries = 60 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.retry_delay = 1 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.send_service_user_token = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.split_loggers = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.verify_ssl = True {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican.verify_ssl_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.auth_section = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.auth_type = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.cafile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.certfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.collect_timing = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.insecure = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.keyfile = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.split_loggers = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] barbican_service_user.timeout = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.approle_role_id = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.approle_secret_id = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.auth_method = approle {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.auth_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.kv_mountpoint = secret {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.kv_path = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.kv_version = 2 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.namespace = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.root_token_id = **** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.ssl_ca_crt_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.timeout = 60.0 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.token_file = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.token_role = None {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.use_ssl = False {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 27 13:11:11 devstack cinder-volume[87921]: DEBUG oslo_service.backend._eventlet.service [None req-5d118e88-f70b-4c6d-841b-d5a4f5512c21 None None] ******************************************************************************** {{(pid=87921) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 27 13:11:11 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.232s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:11:11 devstack cinder-volume[88202]: INFO cinder.volume.driver [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Driver hasn't implemented _init_vendor_properties() Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.driver [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88202) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writer thread running {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.db.api [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Building query based on filter {{(pid=88202) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88202) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:11:11 devstack cinder-volume[88202]: INFO cinder.keymgr.migration [None req-75ec77ba-cb8d-4871-89fa-ac6d333fccf6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 27 13:11:11 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:11:11 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:11:11 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.233s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:11:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Driver initialization completed successfully. Jul 27 13:11:11 devstack cinder-volume[88202]: INFO cinder.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Initiating service 3 cleanup Jul 27 13:11:11 devstack cinder-volume[88202]: INFO cinder.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Service 3 cleanup completed. Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.service [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Creating RPC server for service cinder-volume {{(pid=88202) start /opt/stack/cinder/cinder/service.py:231}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.service [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88202) start /opt/stack/cinder/cinder/service.py:237}} Jul 27 13:11:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:11:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:11:11 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:11:11 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:11:12 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Jul 27 13:11:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.228s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:11:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bcf31fb8-f0da-44ce-9014-cb78d191d94b None None] Driver post RPC initialization completed successfully. Jul 27 13:11:20 devstack cinder-volume[87921]: DEBUG dbcounter [-] [87921] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87921) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:11:21 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:11:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:11:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:11:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 6 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:11:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Flow 'volume_create_manager' (50737738-9c28-4336-aec7-3252a3219950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e692a5-c753-4dfa-aa4b-20b6ffab5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e692a5-c753-4dfa-aa4b-20b6ffab5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1996459275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b6905a-0069-4219-b3d6-bd0f516e6696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea086edcc811455eb47dd561dac90cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:10Z,use_quota=True,user_id='04a9ad47bbb64ea4b9060feed0ad9783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9d0e2b-b1f3-42f9-897b-a5cc26017dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9d0e2b-b1f3-42f9-897b-a5cc26017dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ddba05-2ada-4f58-8ce5-5c654c05a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ddba05-2ada-4f58-8ce5-5c654c05a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b6905a-0069-4219-b3d6-bd0f516e6696', 'volume_name': 'volume-b0b6905a-0069-4219-b3d6-bd0f516e6696', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dd5819-93cd-416f-8fc1-bd35455c8ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dd5819-93cd-416f-8fc1-bd35455c8ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32019db4-293a-4a3c-80b1-9ac73cbdee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Volume b0b6905a-0069-4219-b3d6-bd0f516e6696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b6905a-0069-4219-b3d6-bd0f516e6696', 'volume_size': 1} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1996459275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b6905a-0069-4219-b3d6-bd0f516e6696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea086edcc811455eb47dd561dac90cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:10Z,use_quota=True,user_id='04a9ad47bbb64ea4b9060feed0ad9783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Creating volume b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:12:10 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:12:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:10 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 1073741824 Jul 27 13:12:10 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:11 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 1073741824" returned: 0 in 1.113s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:11 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 Jul 27 13:12:11 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:12 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696" returned: 0 in 0.474s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32019db4-293a-4a3c-80b1-9ac73cbdee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b6905a-0069-4219-b3d6-bd0f516e6696', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df34a2ec-d2e9-4cd2-abe8-a72778da299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:12 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Volume volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 (b0b6905a-0069-4219-b3d6-bd0f516e6696): created successfully Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df34a2ec-d2e9-4cd2-abe8-a72778da299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Flow 'volume_create_manager' (50737738-9c28-4336-aec7-3252a3219950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-b40b4a17-7ef5-4941-be0b-bf621a2f3794 req-a05565af-d2dc-43c5-a638-00a7ba107d35 tempest-VolumesSnapshotsTestJSON-1113774174 None] Created volume successfully. Jul 27 13:12:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Creating offline snapshot fae520cc-976e-4f92-93ff-81a742d0344a of volume b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:12:13 devstack cinder-volume[88202]: INFO oslo.privsep.daemon [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpadvvx2za/privsep.sock'] Jul 27 13:12:13 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpadvvx2za/privsep.sock Jul 27 13:12:13 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: Jul 27 13:12:14 devstack cinder-volume[88202]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 27 13:12:15 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:15 devstack cinder-volume[88202]: INFO oslo.privsep.daemon [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Spawned new privsep daemon via rootwrap Jul 27 13:12:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Accepted privsep connection to /tmp/tmpadvvx2za/privsep.sock {{(pid=88202) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 27 13:12:15 devstack cinder-volume[88202]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 27 13:12:15 devstack cinder-volume[88202]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 27 13:12:15 devstack cinder-volume[88202]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 27 13:12:15 devstack cinder-volume[88202]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88961 Jul 27 13:12:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[62920d3b-2ac4-4c6c-958b-e9539418d0f8]: (2,) {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7cff36-447e-4bd9-abf6-47b3564de8d8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:15 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 Jul 27 13:12:15 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:16 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696" returned: 0 in 1.115s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:16 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a 1G Jul 27 13:12:16 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:17 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a 1G" returned: 0 in 0.851s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:17 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a Jul 27 13:12:17 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:17 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a" returned: 0 in 0.391s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:17 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a is being set with open permissions: ugo+rw Jul 27 13:12:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:17 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a Jul 27 13:12:17 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:18 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a" returned: 0 in 0.524s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:18 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info Jul 27 13:12:18 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:18 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info" returned: 0 in 0.396s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:18 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info is being set with open permissions: ugo+rw Jul 27 13:12:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:18 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info Jul 27 13:12:18 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:19 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.info" returned: 0 in 0.507s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.776s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:19 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-e2674295-9d7b-49e4-a3c7-34d6ef41bd62 req-791fe402-2ce5-4c3a-819f-c0c20ad2f2db tempest-VolumesSnapshotsTestJSON-1113774174 None] Create snapshot completed successfully Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "cinder-fae520cc-976e-4f92-93ff-81a742d0344a-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-fae520cc-976e-4f92-93ff-81a742d0344a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "cinder-quobyte-b0b6905a-0069-4219-b3d6-bd0f516e6696" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-quobyte-b0b6905a-0069-4219-b3d6-bd0f516e6696" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "cinder-quobyte-fae520cc-976e-4f92-93ff-81a742d0344a" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-quobyte-fae520cc-976e-4f92-93ff-81a742d0344a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Deleting offline snapshot fae520cc-976e-4f92-93ff-81a742d0344a of volume b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] snapshot_file for this snap is: volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f944275c-d8bd-409c-afd3-dbf82965f75d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:20 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a Jul 27 13:12:20 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:20 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a" returned: 0 in 0.702s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0b6905a-0069-4219-b3d6-bd0f516e6696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:12:20 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beb59c4-b52c-45e0-8790-e3aab700694b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:21 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 Jul 27 13:12:21 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:21 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696" returned: 0 in 1.052s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:21 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a Jul 27 13:12:21 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Flow 'volume_create_manager' (f0980fce-0a17-4da0-a3c9-d7fa4135c9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774066be-ed6c-4d30-b404-512bd5abfa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774066be-ed6c-4d30-b404-512bd5abfa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-733435636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46659b3d-30b3-433d-ab40-ca371943e3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0006c43a85f04fc582f21f14f3270b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:22Z,use_quota=True,user_id='6d3e4cf340f1476fb6ace9ae37c23ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee7329e-e757-467f-bd3e-81d31d0ee2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee7329e-e757-467f-bd3e-81d31d0ee2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9669bd-0d84-4d29-881f-83f660762f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9669bd-0d84-4d29-881f-83f660762f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46659b3d-30b3-433d-ab40-ca371943e3f0', 'volume_name': 'volume-46659b3d-30b3-433d-ab40-ca371943e3f0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991549f8-366c-4872-8938-40f9b70c8696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991549f8-366c-4872-8938-40f9b70c8696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7745ec8a-750b-4dcf-9e75-1b5aabac558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:21 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Volume 46659b3d-30b3-433d-ab40-ca371943e3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46659b3d-30b3-433d-ab40-ca371943e3f0', 'volume_size': 1} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-733435636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46659b3d-30b3-433d-ab40-ca371943e3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0006c43a85f04fc582f21f14f3270b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:22Z,use_quota=True,user_id='6d3e4cf340f1476fb6ace9ae37c23ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Creating volume 46659b3d-30b3-433d-ab40-ca371943e3f0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:12:21 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:12:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:22 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 1073741824 Jul 27 13:12:22 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:22 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a" returned: 0 in 0.599s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:22 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a Jul 27 13:12:22 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:22 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:22 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696.fae520cc-976e-4f92-93ff-81a742d0344a" returned: 0 in 0.469s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 1073741824" returned: 0 in 0.878s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-quobyte-fae520cc-976e-4f92-93ff-81a742d0344a" released by "_delete_snapshot" :: held 3.198s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-quobyte-b0b6905a-0069-4219-b3d6-bd0f516e6696" released by "delete_snapshot" :: held 3.237s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:23 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 Jul 27 13:12:23 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:23 devstack cinder-volume[88202]: WARNING cinder.quota [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:12:23 devstack cinder-volume[88202]: WARNING cinder.quota [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.quota [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Created reservations ['a15f3d17-6f09-4d99-8ac0-d8042c818aa5', '40e64ea3-49ee-42b1-ad23-a6e514dfe581', 'bcb6840f-18d4-44a4-acf8-922550506c2c', 'f29ef486-52ef-43b1-87b2-015e1c3a5b12'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Delete snapshot completed successfully. Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-350ebf29-b4bd-4b2e-9094-465a67763257 req-1d147a3d-324c-4c05-b344-edcc20247074 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-fae520cc-976e-4f92-93ff-81a742d0344a-delete_snapshot" released by "delete_snapshot" :: held 3.643s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:23 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0" returned: 0 in 0.345s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7745ec8a-750b-4dcf-9e75-1b5aabac558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46659b3d-30b3-433d-ab40-ca371943e3f0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dd4d62-a020-450f-b7d6-a53bf508c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:23 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Volume volume-46659b3d-30b3-433d-ab40-ca371943e3f0 (46659b3d-30b3-433d-ab40-ca371943e3f0): created successfully Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dd4d62-a020-450f-b7d6-a53bf508c688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Flow 'volume_create_manager' (f0980fce-0a17-4da0-a3c9-d7fa4135c9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d9be541f-b36b-4a2e-8825-1c7a1a701bf7 tempest-VolumesAdminNegativeTest-603540165 None] Created volume successfully. Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "cinder-b0b6905a-0069-4219-b3d6-bd0f516e6696-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-b0b6905a-0069-4219-b3d6-bd0f516e6696-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Acquiring lock "cinder-46659b3d-30b3-433d-ab40-ca371943e3f0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "cinder-quobyte-b0b6905a-0069-4219-b3d6-bd0f516e6696" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Lock "cinder-46659b3d-30b3-433d-ab40-ca371943e3f0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-quobyte-b0b6905a-0069-4219-b3d6-bd0f516e6696" acquired by "delete_volume" :: waited 0.053s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Acquiring lock "cinder-quobyte-46659b3d-30b3-433d-ab40-ca371943e3f0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e80d41-27b1-4b1e-907f-2d4ba67a76fa]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Lock "cinder-quobyte-46659b3d-30b3-433d-ab40-ca371943e3f0" acquired by "delete_volume" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e93ce-59b8-4028-8d73-baed840764ee]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:24 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 Jul 27 13:12:24 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:24 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 Jul 27 13:12:24 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:25 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0" returned: 0 in 0.443s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:25 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696" returned: 0 in 0.548s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:25 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0 Jul 27 13:12:25 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:25 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696 Jul 27 13:12:25 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:25 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-46659b3d-30b3-433d-ab40-ca371943e3f0" returned: 0 in 0.288s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Lock "cinder-quobyte-46659b3d-30b3-433d-ab40-ca371943e3f0" released by "delete_volume" :: held 0.806s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:25 devstack cinder-volume[88202]: WARNING cinder.quota [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:12:25 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b0b6905a-0069-4219-b3d6-bd0f516e6696" returned: 0 in 0.326s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-quobyte-b0b6905a-0069-4219-b3d6-bd0f516e6696" released by "delete_volume" :: held 0.958s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Created reservations ['12097b9e-42a9-469a-97da-2bd22543a78e', '9e1d12f4-617c-4cf5-b4e4-7b2285b7c78c', '09efc109-7b9d-4d53-bff1-732b3929613a', '1d0817d7-836e-4805-92d1-2276ad60dc6f'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.quota [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Created reservations ['a9db556d-8b54-4c2d-9c4b-74dce8994df7', 'cacf01a9-8531-4101-b3f7-cc04c6836e4a', 'f352a0ba-90da-4377-8089-621132794c2a', '2859cdfa-0793-4472-bfc4-4269117468bb'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:25 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:12:25 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:25 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:12:25 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:26 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.605s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:26 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:12:26 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Deleted volume successfully. Jul 27 13:12:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-898bfef3-cb6a-4417-9569-bef1be3464d0 tempest-VolumesAdminNegativeTest-603540165 None] Lock "cinder-46659b3d-30b3-433d-ab40-ca371943e3f0-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:26 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.620s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:26 devstack cinder-volume[88202]: DEBUG cinder.manager [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:12:26 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Deleted volume successfully. Jul 27 13:12:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-17ef905d-2163-4d10-9707-0bfb640b244f req-23e194fa-7b0d-47ab-8014-23563b14d0b3 tempest-VolumesSnapshotsTestJSON-1113774174 None] Lock "cinder-b0b6905a-0069-4219-b3d6-bd0f516e6696-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9e79d310-8e18-4dc6-bd2d-299538983c89 tempest-GroupSnapshotsTest-1517296987 None] Group tempest-GroupSnapshotsTest-Group-1949642023: creating Jul 27 13:12:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9e79d310-8e18-4dc6-bd2d-299538983c89 tempest-GroupSnapshotsTest-1517296987 None] Group tempest-GroupSnapshotsTest-Group-1949642023: created successfully Jul 27 13:12:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9e79d310-8e18-4dc6-bd2d-299538983c89 tempest-GroupSnapshotsTest-1517296987 None] Create group completed successfully. Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:33 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:12:33 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:33 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.413s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 8 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (3a3bdae8-8b99-454e-901f-ee955e4dfcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39019b0e-8c75-4459-a248-5e5a6d20ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39019b0e-8c75-4459-a248-5e5a6d20ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1480093618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17473ad9-6929-4041-b321-18aff7de288e,host='devstack@QuobyteHD#QuobyteHD',id=4b7a5b23-6089-4b16-abbe-81508ed750e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:33Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec00bf0f-be1a-4c77-859e-c546e77b7e5c),volume_type_id=ec00bf0f-be1a-4c77-859e-c546e77b7e5c)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67584efe-f7d8-4e78-bcda-e52e840b15da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67584efe-f7d8-4e78-bcda-e52e840b15da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b731bdf-0dd9-4f17-9e40-f2d9760e42e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b731bdf-0dd9-4f17-9e40-f2d9760e42e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7a5b23-6089-4b16-abbe-81508ed750e0', 'volume_name': 'volume-4b7a5b23-6089-4b16-abbe-81508ed750e0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5e5609-3e07-48dd-b223-989aec74aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5e5609-3e07-48dd-b223-989aec74aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c4ac04-37b7-44d4-91ae-0ec509284b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:33 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Volume 4b7a5b23-6089-4b16-abbe-81508ed750e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7a5b23-6089-4b16-abbe-81508ed750e0', 'volume_size': 1} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17473ad9-6929-4041-b321-18aff7de288e,created_at=2026-07-27T11:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1480093618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17473ad9-6929-4041-b321-18aff7de288e,host='devstack@QuobyteHD#QuobyteHD',id=4b7a5b23-6089-4b16-abbe-81508ed750e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:33Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec00bf0f-be1a-4c77-859e-c546e77b7e5c),volume_type_id=ec00bf0f-be1a-4c77-859e-c546e77b7e5c)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Creating volume 4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:12:33 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:12:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:33 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 1073741824 Jul 27 13:12:33 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:34 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 1073741824" returned: 0 in 0.745s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:34 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:34 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:34 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c4ac04-37b7-44d4-91ae-0ec509284b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7a5b23-6089-4b16-abbe-81508ed750e0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7fde99-c0fa-4f06-b7ee-d660d413ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:34 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Volume volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 (4b7a5b23-6089-4b16-abbe-81508ed750e0): created successfully Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7fde99-c0fa-4f06-b7ee-d660d413ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (3a3bdae8-8b99-454e-901f-ee955e4dfcf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:34 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e46e32f1-6780-4fbf-a831-8a8ed7e9f4ea tempest-GroupSnapshotsTest-1517296987 None] Created volume successfully. Jul 27 13:12:36 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] GroupSnapshot f673ca2d-d835-4102-a9f0-da76cdfa9785: creating. Jul 27 13:12:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Group snapshot f673ca2d-d835-4102-a9f0-da76cdfa9785: creating. {{(pid=88202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 27 13:12:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Creating offline snapshot c57e9e9f-519d-4030-9e1f-5111ee92f0e1 of volume 4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:12:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[34275a00-93c9-41d7-aa76-cba8d0d5aa7d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:36 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:36 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:37 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.504s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:37 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 1G Jul 27 13:12:37 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Flow 'volume_create_manager' (66cc6792-59e0-4df0-b4a2-91529aa59cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5fb9db-029c-4d09-85a2-ea86a6708925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5fb9db-029c-4d09-85a2-ea86a6708925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-137975513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9abc25563d49e4a50f46991d24d65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:37Z,use_quota=True,user_id='014955c8ff8944f8872a287f64de5243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226e9a12-1358-4e30-97b6-fb7e51a4dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226e9a12-1358-4e30-97b6-fb7e51a4dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8601031e-c644-46a3-a2a3-6334706c3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8601031e-c644-46a3-a2a3-6334706c3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b', 'volume_name': 'volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0033e2-b32b-4dc1-9781-57eecacb974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0033e2-b32b-4dc1-9781-57eecacb974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b71321d-7e4a-4b25-a436-9de02556d482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Volume 4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b', 'volume_size': 1} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:37 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 1G" returned: 0 in 0.661s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:37 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 Jul 27 13:12:37 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:38 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1" returned: 0 in 0.407s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:38 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:12:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:38 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 Jul 27 13:12:38 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:38 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1" returned: 0 in 0.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:38 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info Jul 27 13:12:38 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:38 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info" returned: 0 in 0.307s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:38 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:12:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:38 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info Jul 27 13:12:38 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:39 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.info" returned: 0 in 0.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-137975513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9abc25563d49e4a50f46991d24d65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:12:37Z,use_quota=True,user_id='014955c8ff8944f8872a287f64de5243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Creating volume 4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:12:39 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:39 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b 1073741824 Jul 27 13:12:39 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-91c793d4-61dc-44fd-ac89-21104cf49ef2 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot f673ca2d-d835-4102-a9f0-da76cdfa9785: created successfully Jul 27 13:12:39 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b 1073741824" returned: 0 in 0.558s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:39 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b Jul 27 13:12:39 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:40 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b" returned: 0 in 0.434s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b71321d-7e4a-4b25-a436-9de02556d482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44bc5b0-a942-4bb3-8bb7-5d0f34adfe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:12:40 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Volume volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b (4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b): created successfully Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44bc5b0-a942-4bb3-8bb7-5d0f34adfe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Flow 'volume_create_manager' (66cc6792-59e0-4df0-b4a2-91529aa59cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:12:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c1b83830-76d2-4a59-8a28-e813a8bd765e tempest-ServerActionsTestOtherA-1977739147 None] Created volume successfully. Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-c57e9e9f-519d-4030-9e1f-5111ee92f0e1-d64b4fd6-6bec-489a-a575-89ff847271fa" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-c57e9e9f-519d-4030-9e1f-5111ee92f0e1-d64b4fd6-6bec-489a-a575-89ff847271fa" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Creating volume d64b4fd6-6bec-489a-a575-89ff847271fa from snapshot c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-d64b4fd6-6bec-489a-a575-89ff847271fa" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-d64b4fd6-6bec-489a-a575-89ff847271fa" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] snapshot: c57e9e9f-519d-4030-9e1f-5111ee92f0e1, volume: d64b4fd6-6bec-489a-a575-89ff847271fa, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec68fd16-8359-49d5-bd1b-d30b343705a7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:41 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 Jul 27 13:12:41 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:41 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1" returned: 0 in 0.643s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b7a5b23-6089-4b16-abbe-81508ed750e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:12:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:12:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:12:41 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba24c37-b6e2-412a-a247-6c35990b464d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:41 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:41 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:42 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.510s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:42 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:12:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:42 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa Jul 27 13:12:42 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:48 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa" returned: 0 in 6.375s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ec22dc-6f26-4938-aca7-98803814f6f1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:48 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:48 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:49 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.912s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:12:49 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Converted 1024.00 MB image at 160.59 MB/s Jul 27 13:12:49 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:49 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa Jul 27 13:12:49 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:49 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa" returned: 0 in 0.505s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-d64b4fd6-6bec-489a-a575-89ff847271fa" released by "_copy_volume_from_snapshot" :: held 9.087s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-c57e9e9f-519d-4030-9e1f-5111ee92f0e1-d64b4fd6-6bec-489a-a575-89ff847271fa" released by "_create_volume_from_snapshot" :: held 9.139s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.157s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a40e89ba-3354-42c6-aa6e-061545b81c30 tempest-GroupSnapshotsTest-1517296987 None] Create group from source-snapshot-f673ca2d-d835-4102-a9f0-da76cdfa9785 completed successfully. Jul 27 13:12:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-d64b4fd6-6bec-489a-a575-89ff847271fa" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-d64b4fd6-6bec-489a-a575-89ff847271fa" acquired by "delete_volume" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf7d4d7-76b5-485d-a5b6-48427c597078]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:51 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa Jul 27 13:12:51 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:52 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa" returned: 0 in 0.503s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:52 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa Jul 27 13:12:52 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:52 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d64b4fd6-6bec-489a-a575-89ff847271fa" returned: 0 in 0.307s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-d64b4fd6-6bec-489a-a575-89ff847271fa" released by "delete_volume" :: held 0.876s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['e4d80856-4095-468e-89b3-e6793f296ad1'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:52 devstack cinder-volume[88202]: WARNING cinder.quota [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1210545106 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1210545106, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:12:52 devstack cinder-volume[88202]: WARNING cinder.quota [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1210545106 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1210545106, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['5a967918-aa38-4d28-aca6-962d383162f8', '4b1fd486-63de-4614-a6eb-1f808040bfc0', 'c5553c56-8556-45f9-be2b-3dbfe297ebd4', '79779093-e2f3-42ae-8153-2ca02061a236'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:52 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:12:52 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot f673ca2d-d835-4102-a9f0-da76cdfa9785: deleting Jul 27 13:12:53 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot f673ca2d-d835-4102-a9f0-da76cdfa9785: deleting {{(pid=88202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.529s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:12:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3e6e1471-acd6-4014-bcbf-23728e9f957f tempest-GroupSnapshotsTest-1517296987 None] Delete group completed successfully. Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-4b7a5b23-6089-4b16-abbe-81508ed750e0" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-4b7a5b23-6089-4b16-abbe-81508ed750e0" acquired by "delete_snapshot" :: waited 0.061s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-c57e9e9f-519d-4030-9e1f-5111ee92f0e1" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-c57e9e9f-519d-4030-9e1f-5111ee92f0e1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Deleting offline snapshot c57e9e9f-519d-4030-9e1f-5111ee92f0e1 of volume 4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] snapshot_file for this snap is: volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9546fdc1-d53a-46ce-b535-2bd6b9907cb4]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:53 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 Jul 27 13:12:53 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:54 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1" returned: 0 in 0.487s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b7a5b23-6089-4b16-abbe-81508ed750e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:12:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f2bae-4f2c-4a55-8805-d3ff607de87c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:54 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:54 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:54 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.509s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:54 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 Jul 27 13:12:54 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:55 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1" returned: 0 in 0.710s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:55 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1 Jul 27 13:12:55 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:55 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0.c57e9e9f-519d-4030-9e1f-5111ee92f0e1" returned: 0 in 0.584s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-c57e9e9f-519d-4030-9e1f-5111ee92f0e1" released by "_delete_snapshot" :: held 2.511s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-4b7a5b23-6089-4b16-abbe-81508ed750e0" released by "delete_snapshot" :: held 2.585s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:56 devstack cinder-volume[88202]: WARNING cinder.quota [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1210545106 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1210545106, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:12:56 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['4630b77e-bd75-4d55-883f-dcd4cb97aa83', '7e1d44e4-75dd-4acb-b074-ecf5086732d6', '0f46c3b7-959b-46a2-b944-621077f8736f', '9eef0274-60d0-4ff0-a5b8-5a750ba0f9be'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d803389b-1527-4595-ba59-a6810f657d26 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot f673ca2d-d835-4102-a9f0-da76cdfa9785: deleted successfully Jul 27 13:12:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-4b7a5b23-6089-4b16-abbe-81508ed750e0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:12:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-4b7a5b23-6089-4b16-abbe-81508ed750e0" acquired by "delete_volume" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:12:57 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c487972c-b13b-4ccc-a990-5581ba3db789]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:12:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:57 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:57 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:58 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.567s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:58 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0 Jul 27 13:12:58 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:12:59 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b7a5b23-6089-4b16-abbe-81508ed750e0" returned: 0 in 0.851s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-4b7a5b23-6089-4b16-abbe-81508ed750e0" released by "delete_volume" :: held 1.586s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['0573e022-b78a-4c32-a2c9-b5efba720dad'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:59 devstack cinder-volume[88202]: WARNING cinder.db.api [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1210545106'] Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['34b08dfb-3432-4171-97b8-3765d115fedc', 'f1f32b93-8e17-4dd1-aad4-1b96b5f06f6b', '2e5877e9-bdf1-4c34-b7f9-6274cd2a8618', 'addc75e3-d38f-4dd2-abad-83fd59a3ed45'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:12:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:12:59 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:12:59 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:00 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.519s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:00 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cd8a740f-0cec-493f-93bf-7a18bc392809 tempest-GroupSnapshotsTest-1517296987 None] Delete group completed successfully. Jul 27 13:13:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-92eb8f3c-4cc1-430b-a50c-8d91c27fd569 tempest-GroupSnapshotsTest-1517296987 None] Group tempest-GroupSnapshotsTest-Group-1479570908: creating Jul 27 13:13:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-92eb8f3c-4cc1-430b-a50c-8d91c27fd569 tempest-GroupSnapshotsTest-1517296987 None] Group tempest-GroupSnapshotsTest-Group-1479570908: created successfully Jul 27 13:13:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-92eb8f3c-4cc1-430b-a50c-8d91c27fd569 tempest-GroupSnapshotsTest-1517296987 None] Create group completed successfully. Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=67,cinder:UPDATE=59,cinder:DELETE=4,cinder:INSERT=19 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=77,cinder:SELECT=62,cinder:INSERT=13,cinder:DELETE=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Flow 'volume_create_manager' (638f930a-0f75-4961-bb44-b7ccab646a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f92263-9854-45a7-ae89-689c6c247d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f92263-9854-45a7-ae89-689c6c247d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1956059710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cc0b40-be40-4d49-a571-fffb2dd9603b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9237d7014344e6ab77a8c74e7c197e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:03Z,use_quota=True,user_id='f6bb87586ff24069ba70eec070c7548a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4843804-3fe5-4045-84ab-7eac01afb424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4843804-3fe5-4045-84ab-7eac01afb424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50351e89-efd7-46c2-a4b9-f11f2d82e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50351e89-efd7-46c2-a4b9-f11f2d82e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cc0b40-be40-4d49-a571-fffb2dd9603b', 'volume_name': 'volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eed8437-2fab-43a8-8af8-41079d7bbcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eed8437-2fab-43a8-8af8-41079d7bbcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30defbb3-a030-4045-92b7-33a685abcb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Volume d1cc0b40-be40-4d49-a571-fffb2dd9603b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b', 'volume_size': 1} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1956059710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cc0b40-be40-4d49-a571-fffb2dd9603b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9237d7014344e6ab77a8c74e7c197e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:03Z,use_quota=True,user_id='f6bb87586ff24069ba70eec070c7548a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Creating volume d1cc0b40-be40-4d49-a571-fffb2dd9603b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:13:03 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (e7cda3a4-cc95-4a55-8c81-f5b7f015652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a61f304-17b5-4c3d-8280-3c0741265aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b 1073741824 Jul 27 13:13:03 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a61f304-17b5-4c3d-8280-3c0741265aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558022695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47f0fafe-3990-48e9-8f43-54db1f1c1bc4,host='devstack@QuobyteHD#QuobyteHD',id=2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:04Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3103af96-51ca-4659-b57b-29f619907057),volume_type_id=3103af96-51ca-4659-b57b-29f619907057)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfddb95-8a3d-425a-a448-1a04a1ce2c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfddb95-8a3d-425a-a448-1a04a1ce2c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c582ebe-58e1-4211-aea2-3c8d94699d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c582ebe-58e1-4211-aea2-3c8d94699d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3', 'volume_name': 'volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d61c483-17cc-4b8f-9f8a-77b3f9553b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d61c483-17cc-4b8f-9f8a-77b3f9553b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466226da-6ae9-452b-83e8-cdb765cf7d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Volume 2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3', 'volume_size': 1} Jul 27 13:13:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:04 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b 1073741824" returned: 0 in 0.643s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:04 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b Jul 27 13:13:04 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:05 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b" returned: 0 in 0.431s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47f0fafe-3990-48e9-8f43-54db1f1c1bc4,created_at=2026-07-27T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558022695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47f0fafe-3990-48e9-8f43-54db1f1c1bc4,host='devstack@QuobyteHD#QuobyteHD',id=2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:04Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3103af96-51ca-4659-b57b-29f619907057),volume_type_id=3103af96-51ca-4659-b57b-29f619907057)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Creating volume 2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:13:05 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30defbb3-a030-4045-92b7-33a685abcb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:05 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 1073741824 Jul 27 13:13:05 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1062eb-f6c9-4c59-a4b8-4a09c1ec18de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Volume volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b (d1cc0b40-be40-4d49-a571-fffb2dd9603b): created successfully Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1062eb-f6c9-4c59-a4b8-4a09c1ec18de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Flow 'volume_create_manager' (638f930a-0f75-4961-bb44-b7ccab646a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a34f0869-ae5c-4f15-a3e4-d48a315aaa2a tempest-DeleteServersTestJSON-1403507009 None] Created volume successfully. Jul 27 13:13:06 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 1073741824" returned: 0 in 0.929s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:06 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 Jul 27 13:13:06 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:06 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" returned: 0 in 0.437s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466226da-6ae9-452b-83e8-cdb765cf7d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afae9b6-e9e6-4ba8-bc9c-dba6df475bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:06 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Volume volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 (2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3): created successfully Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afae9b6-e9e6-4ba8-bc9c-dba6df475bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (e7cda3a4-cc95-4a55-8c81-f5b7f015652b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-73c3b314-7b2f-475e-ad6a-6663ddc77a12 tempest-GroupSnapshotsTest-1517296987 None] Created volume successfully. Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (5661c69b-2a27-41c6-a519-01303d3bc815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e64cba-7b51-4b30-ba65-170c985633e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e64cba-7b51-4b30-ba65-170c985633e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615152325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47f0fafe-3990-48e9-8f43-54db1f1c1bc4,host='devstack@QuobyteHD#QuobyteHD',id=0d69e0f3-2ebc-4e00-87a2-bfef8902b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:08Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3103af96-51ca-4659-b57b-29f619907057),volume_type_id=3103af96-51ca-4659-b57b-29f619907057)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b0261e-6ed6-40da-bb6e-59977fecfb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b0261e-6ed6-40da-bb6e-59977fecfb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5bf1cd-bb15-48b5-8f78-fb89c6340682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5bf1cd-bb15-48b5-8f78-fb89c6340682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d69e0f3-2ebc-4e00-87a2-bfef8902b172', 'volume_name': 'volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07619f8b-6899-442e-b9f4-0c62533956b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07619f8b-6899-442e-b9f4-0c62533956b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfc2f2a-7045-4592-85ee-ace6e1735b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Volume 0d69e0f3-2ebc-4e00-87a2-bfef8902b172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172', 'volume_size': 1} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47f0fafe-3990-48e9-8f43-54db1f1c1bc4,created_at=2026-07-27T11:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615152325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47f0fafe-3990-48e9-8f43-54db1f1c1bc4,host='devstack@QuobyteHD#QuobyteHD',id=0d69e0f3-2ebc-4e00-87a2-bfef8902b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:08Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3103af96-51ca-4659-b57b-29f619907057),volume_type_id=3103af96-51ca-4659-b57b-29f619907057)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Creating volume 0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:13:08 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:13:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:08 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 1073741824 Jul 27 13:13:08 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:09 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 1073741824" returned: 0 in 1.145s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:09 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 Jul 27 13:13:09 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:10 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" returned: 0 in 0.652s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfc2f2a-7045-4592-85ee-ace6e1735b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2ba715-5bb1-4068-a10f-aa4df4b8d1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Volume volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 (0d69e0f3-2ebc-4e00-87a2-bfef8902b172): created successfully Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2ba715-5bb1-4068-a10f-aa4df4b8d1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (5661c69b-2a27-41c6-a519-01303d3bc815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b3b1a216-1c65-429c-9f5c-db68703fa0ac tempest-GroupSnapshotsTest-1517296987 None] Created volume successfully. Jul 27 13:13:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f352dca2-a576-465d-bd80-f13765964df2 tempest-GroupSnapshotsTest-1517296987 None] Update group completed successfully. Jul 27 13:13:11 devstack cinder-volume[88202]: WARNING py.warnings [req-0fb3757d-8dd5-466e-a5be-62069a430936 req-8f3079e7-f0b7-4ac2-a0f3-9cf1bc13db35 tempest-DeleteServersTestJSON-1403507009 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 27 13:13:11 devstack cinder-volume[88202]: .first() Jul 27 13:13:11 devstack cinder-volume[88202]: Jul 27 13:13:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-0fb3757d-8dd5-466e-a5be-62069a430936 req-8f3079e7-f0b7-4ac2-a0f3-9cf1bc13db35 tempest-DeleteServersTestJSON-1403507009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-0fb3757d-8dd5-466e-a5be-62069a430936 req-8f3079e7-f0b7-4ac2-a0f3-9cf1bc13db35 tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-0fb3757d-8dd5-466e-a5be-62069a430936 req-8f3079e7-f0b7-4ac2-a0f3-9cf1bc13db35 tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-0fb3757d-8dd5-466e-a5be-62069a430936 req-8f3079e7-f0b7-4ac2-a0f3-9cf1bc13db35 tempest-DeleteServersTestJSON-1403507009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cce47b8-ca1e-4deb-8b09-a63d59fc9ad8', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:13:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-0fb3757d-8dd5-466e-a5be-62069a430936 req-8f3079e7-f0b7-4ac2-a0f3-9cf1bc13db35 tempest-DeleteServersTestJSON-1403507009 None] attachment_update completed successfully. Jul 27 13:13:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-25ad2d15-70d4-4c8e-bec0-c2f7930081c4 tempest-GroupSnapshotsTest-1517296987 None] Update group completed successfully. Jul 27 13:13:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ed441865-9cdf-4b30-a73a-81a879268428 tempest-GroupSnapshotsTest-1517296987 None] Update group completed successfully. Jul 27 13:13:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-db82cb03-9485-458e-b4ed-eecb8ca69532 tempest-GroupSnapshotsTest-1517296987 None] Update group completed successfully. Jul 27 13:13:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-40b4cebc-0357-4c30-b8e3-9b7e02d7cc13 req-e3d6a529-0800-4cf6-890b-ce9ad2840a30 tempest-DeleteServersTestJSON-1403507009 None] Terminate volume connection completed successfully. Jul 27 13:13:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-40b4cebc-0357-4c30-b8e3-9b7e02d7cc13 req-e3d6a529-0800-4cf6-890b-ce9ad2840a30 tempest-DeleteServersTestJSON-1403507009 None] Deleting attachment 4cce47b8-ca1e-4deb-8b09-a63d59fc9ad8. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:13:17 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] GroupSnapshot 875f6766-2b35-4ff3-b19a-778a92003921: creating. Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Group snapshot 875f6766-2b35-4ff3-b19a-778a92003921: creating. {{(pid=88202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Creating offline snapshot 5e067d68-0019-4183-8934-c5f3e252bf42 of volume 0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4605d9e5-e5be-4818-bb31-93831ff2c850]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:17 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 Jul 27 13:13:17 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:17 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:17 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 1G Jul 27 13:13:17 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Acquiring lock "cinder-d1cc0b40-be40-4d49-a571-fffb2dd9603b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Lock "cinder-d1cc0b40-be40-4d49-a571-fffb2dd9603b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Acquiring lock "cinder-quobyte-d1cc0b40-be40-4d49-a571-fffb2dd9603b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Lock "cinder-quobyte-d1cc0b40-be40-4d49-a571-fffb2dd9603b" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343b1b0-07f2-4ea4-a3c2-f7bd7b45f630]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:18 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 1G" returned: 0 in 0.699s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:18 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 Jul 27 13:13:18 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:18 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b Jul 27 13:13:18 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:18 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42" returned: 0 in 0.339s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:18 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:18 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 Jul 27 13:13:18 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:18 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b" returned: 0 in 0.608s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:18 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b Jul 27 13:13:18 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:19 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:19 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d1cc0b40-be40-4d49-a571-fffb2dd9603b" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:19 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info Jul 27 13:13:19 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Lock "cinder-quobyte-d1cc0b40-be40-4d49-a571-fffb2dd9603b" released by "delete_volume" :: held 1.044s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Created reservations ['058ec713-aa8b-47e4-95ab-783545e95841', '1503314b-e638-479c-9209-4b832d52c66e', '576506f3-ef01-4920-9c63-1a4ebe29855e', '5b04351b-208c-429a-bfec-b071bd098d17'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:19 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:13:19 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:19 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info" returned: 0 in 0.449s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:19 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:19 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info Jul 27 13:13:19 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:19 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.438s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:19 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Deleted volume successfully. Jul 27 13:13:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-80cf2f09-43fd-4c87-a8d1-e8ae189f49b5 tempest-DeleteServersTestJSON-1403507009 None] Lock "cinder-d1cc0b40-be40-4d49-a571-fffb2dd9603b-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:20 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.info" returned: 0 in 0.523s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Creating offline snapshot d09e1692-8030-4f0a-adf4-88cb5a867bc5 of volume 2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae8e733-b2f6-48e6-837f-1cd1a54a8265]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:20 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 Jul 27 13:13:20 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:20 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" returned: 0 in 0.427s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:20 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 1G Jul 27 13:13:20 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:21 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 1G" returned: 0 in 0.474s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:21 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 Jul 27 13:13:21 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:21 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5" returned: 0 in 0.359s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:21 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:13:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:21 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 Jul 27 13:13:21 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:21 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5" returned: 0 in 0.350s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:21 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info Jul 27 13:13:21 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:22 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:22 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:13:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:22 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info Jul 27 13:13:22 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:22 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.info" returned: 0 in 0.695s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.801s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b45c29a7-5ed0-4f5f-9fe7-fe5af38c5d6f req-46b46e6f-f30e-4a0d-954e-b742ca3987f1 tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b45c29a7-5ed0-4f5f-9fe7-fe5af38c5d6f req-46b46e6f-f30e-4a0d-954e-b742ca3987f1 tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-b45c29a7-5ed0-4f5f-9fe7-fe5af38c5d6f req-46b46e6f-f30e-4a0d-954e-b742ca3987f1 tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9bfa1bd9-c561-40f7-86ac-c0f27fe93fa3 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 875f6766-2b35-4ff3-b19a-778a92003921: created successfully Jul 27 13:13:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-b45c29a7-5ed0-4f5f-9fe7-fe5af38c5d6f req-46b46e6f-f30e-4a0d-954e-b742ca3987f1 tempest-ServerActionsTestOtherA-1977739147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da964593-8df4-439e-b8d2-c734790ebcbe', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:13:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-b45c29a7-5ed0-4f5f-9fe7-fe5af38c5d6f req-46b46e6f-f30e-4a0d-954e-b742ca3987f1 tempest-ServerActionsTestOtherA-1977739147 None] attachment_update completed successfully. Jul 27 13:13:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 875f6766-2b35-4ff3-b19a-778a92003921: deleting Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 875f6766-2b35-4ff3-b19a-778a92003921: deleting {{(pid=88202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-5e067d68-0019-4183-8934-c5f3e252bf42" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-5e067d68-0019-4183-8934-c5f3e252bf42" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Deleting offline snapshot 5e067d68-0019-4183-8934-c5f3e252bf42 of volume 0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] snapshot_file for this snap is: volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf67ea3-0a4f-4c00-9d8a-cc9a6b593bee]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:24 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 Jul 27 13:13:24 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:24 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42" returned: 0 in 0.749s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:13:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e184cc1e-a831-46e7-955a-3c3e9ad0c80f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:25 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 Jul 27 13:13:25 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:25 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:25 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 Jul 27 13:13:25 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:26 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42" returned: 0 in 0.494s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:26 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42 Jul 27 13:13:26 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:26 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172.5e067d68-0019-4183-8934-c5f3e252bf42" returned: 0 in 0.395s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-5e067d68-0019-4183-8934-c5f3e252bf42" released by "_delete_snapshot" :: held 2.324s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" released by "delete_snapshot" :: held 2.377s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-d09e1692-8030-4f0a-adf4-88cb5a867bc5" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-d09e1692-8030-4f0a-adf4-88cb5a867bc5" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Deleting offline snapshot d09e1692-8030-4f0a-adf4-88cb5a867bc5 of volume 2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] snapshot_file for this snap is: volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956bd95-f1c6-4781-b662-7505702c6298]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:27 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 Jul 27 13:13:27 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:27 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5" returned: 0 in 0.667s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:13:27 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274c53c-67ae-478e-acfa-bca9c00d56fa]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:27 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 Jul 27 13:13:27 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:28 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" returned: 0 in 0.944s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:28 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 Jul 27 13:13:28 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:29 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5" returned: 0 in 0.635s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:29 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5 Jul 27 13:13:29 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:29 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3.d09e1692-8030-4f0a-adf4-88cb5a867bc5" returned: 0 in 0.469s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-d09e1692-8030-4f0a-adf4-88cb5a867bc5" released by "_delete_snapshot" :: held 2.945s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" released by "delete_snapshot" :: held 3.007s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:29 devstack cinder-volume[88202]: WARNING cinder.quota [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-423865858 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-423865858, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:13:29 devstack cinder-volume[88202]: WARNING cinder.quota [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-423865858 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-423865858, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['af3b2f99-3c4a-429e-97a4-8d88217c0252', 'fb8733b8-1441-40fd-8fd4-aca50109357c', '46b60059-8fd4-4d5b-87f3-3f641be82e71', '011e355c-0342-41a3-8906-bfce025caf5a'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:29 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-63182091-f5ce-4234-80f7-40fe73e304b1 tempest-ServerActionsTestOtherA-1977739147 None] Terminate volume connection completed successfully. Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-63182091-f5ce-4234-80f7-40fe73e304b1 tempest-ServerActionsTestOtherA-1977739147 None] Deleting attachment da964593-8df4-439e-b8d2-c734790ebcbe. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:13:29 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['9bed238f-ba7c-49cf-bbb6-cb01b21c53bf', '6f20b050-e276-4f3a-afda-3285f92ed4f9', '384e618e-3eaa-4509-a132-8ed224bd94d0', 'a656dac9-10f1-4b53-9914-58560394a7d9'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b267ec96-c9b8-4523-8191-8a0595f293eb tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 875f6766-2b35-4ff3-b19a-778a92003921: deleted successfully Jul 27 13:13:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-0464b468-4f1a-40d7-964c-fdd7af995ae2 tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-0464b468-4f1a-40d7-964c-fdd7af995ae2 tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-0464b468-4f1a-40d7-964c-fdd7af995ae2 tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-0464b468-4f1a-40d7-964c-fdd7af995ae2 tempest-ServerActionsTestOtherA-1977739147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9168b1fa-5470-4a30-9cc9-7c526dd4a42e', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:13:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-31882102-347b-4488-b6bf-6378b2d3bc78 req-0464b468-4f1a-40d7-964c-fdd7af995ae2 tempest-ServerActionsTestOtherA-1977739147 None] attachment_update completed successfully. Jul 27 13:13:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" acquired by "delete_volume" :: waited 0.062s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa28a8-0c05-484f-843c-eebcae7bb8c0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:32 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 Jul 27 13:13:32 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:33 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" returned: 0 in 0.793s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:33 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:13:33 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:33 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172 Jul 27 13:13:33 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:33 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.480s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 8 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:13:33 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" returned: 0 in 0.520s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-0d69e0f3-2ebc-4e00-87a2-bfef8902b172" released by "delete_volume" :: held 1.497s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0a52a-434c-4a88-b5cb-c541e9a0d477]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:33 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 Jul 27 13:13:33 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:34 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" returned: 0 in 0.688s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:34 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3 Jul 27 13:13:34 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:34 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" returned: 0 in 0.529s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-2a04ff17-ddf9-460e-9f91-e6b6bcc7bbf3" released by "delete_volume" :: held 1.345s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['1b590253-46bd-43c6-9686-0fc0522e9157'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:35 devstack cinder-volume[88202]: WARNING cinder.quota [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-423865858 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-423865858, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['af0c3b22-958f-4e4d-9751-a47f8d6a0019', 'b5bb8825-5c45-4a39-bc60-f69c81c89355', '6f901997-005c-41eb-9975-13cb96712509', '42b50b33-db6d-4697-992f-ad6aea273231'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['6dbda8bf-0cd7-46c0-ab8a-8281eb27c83c', 'ce36c487-0385-44dc-ac60-e687c1c68fe1', 'ad14482e-e2c6-4974-a068-008231466020', '5991d3d7-00ac-4a43-88d0-e90e86d8cc67'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:35 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:13:35 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:36 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.500s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:36 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:36 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-794d9afa-b742-4fcf-b41e-bfd09c49611b tempest-GroupSnapshotsTest-1517296987 None] Delete group completed successfully. Jul 27 13:13:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a6167af2-fb43-47dd-b647-84fd56ddf9ac tempest-GroupSnapshotsTest-1517296987 None] Group tempest-GroupSnapshotsTest-Group-1595106344: creating Jul 27 13:13:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a6167af2-fb43-47dd-b647-84fd56ddf9ac tempest-GroupSnapshotsTest-1517296987 None] Group tempest-GroupSnapshotsTest-Group-1595106344: created successfully Jul 27 13:13:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a6167af2-fb43-47dd-b647-84fd56ddf9ac tempest-GroupSnapshotsTest-1517296987 None] Create group completed successfully. Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (0140fade-f1c0-4c5f-aee6-cfb3cc8c2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7465c022-72d5-41c7-9cb5-2ad6ab4c810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7465c022-72d5-41c7-9cb5-2ad6ab4c810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-791548482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47bc67bb-07a5-442d-9d35-3b257bbcd009,host='devstack@QuobyteHD#QuobyteHD',id=7ffb143e-1ae9-4f05-bfa4-f384a771fc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:40Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9189b12-8c44-465a-ab5a-8ac387c6835d),volume_type_id=b9189b12-8c44-465a-ab5a-8ac387c6835d)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9558a6-3a2d-42f5-9a42-b63e183cb6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9558a6-3a2d-42f5-9a42-b63e183cb6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb3b5da-e4b4-473a-b443-0a5c05ceb069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb3b5da-e4b4-473a-b443-0a5c05ceb069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffb143e-1ae9-4f05-bfa4-f384a771fc25', 'volume_name': 'volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52659e05-a474-403b-a32c-8842d33fa80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52659e05-a474-403b-a32c-8842d33fa80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64183038-322e-4944-b3bd-425a56c5add2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:40 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Volume 7ffb143e-1ae9-4f05-bfa4-f384a771fc25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25', 'volume_size': 1} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47bc67bb-07a5-442d-9d35-3b257bbcd009,created_at=2026-07-27T11:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-791548482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47bc67bb-07a5-442d-9d35-3b257bbcd009,host='devstack@QuobyteHD#QuobyteHD',id=7ffb143e-1ae9-4f05-bfa4-f384a771fc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cca9b087d64b54ae74c227d81636aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:40Z,use_quota=True,user_id='eccca92b409b4229bd0b7dccda64510a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9189b12-8c44-465a-ab5a-8ac387c6835d),volume_type_id=b9189b12-8c44-465a-ab5a-8ac387c6835d)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Creating volume 7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:13:40 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:13:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:40 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 1073741824 Jul 27 13:13:40 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:41 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 1073741824" returned: 0 in 0.692s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:41 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 Jul 27 13:13:41 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:41 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" returned: 0 in 0.433s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64183038-322e-4944-b3bd-425a56c5add2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb0f384-6b28-4cb4-b1cb-d05f2169ae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:41 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Volume volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 (7ffb143e-1ae9-4f05-bfa4-f384a771fc25): created successfully Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb0f384-6b28-4cb4-b1cb-d05f2169ae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Flow 'volume_create_manager' (0140fade-f1c0-4c5f-aee6-cfb3cc8c2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7fed872d-7a3d-46d7-b237-ab6605243ab5 tempest-GroupSnapshotsTest-1517296987 None] Created volume successfully. Jul 27 13:13:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] GroupSnapshot 37ca57e3-3e05-490a-a426-d7d95f35dabb: creating. Jul 27 13:13:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Group snapshot 37ca57e3-3e05-490a-a426-d7d95f35dabb: creating. {{(pid=88202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 27 13:13:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Creating offline snapshot 848c297c-1c5b-4f4f-8011-6a6b154ec872 of volume 7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:13:43 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5696416-3d2c-4055-a4b3-f4f8c814a6b5]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:43 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 Jul 27 13:13:43 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:44 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" returned: 0 in 0.563s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:44 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 1G Jul 27 13:13:44 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:44 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 1G" returned: 0 in 0.632s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:44 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 Jul 27 13:13:44 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:45 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872" returned: 0 in 0.542s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:45 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:13:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:45 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 Jul 27 13:13:45 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:45 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872" returned: 0 in 0.501s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:45 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info Jul 27 13:13:45 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:46 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info" returned: 0 in 0.555s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:46 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:13:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:46 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info Jul 27 13:13:46 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:46 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.info" returned: 0 in 0.541s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.518s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-baf4c8d9-eb01-47ce-8a8a-9dcbd8eaf298 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 37ca57e3-3e05-490a-a426-d7d95f35dabb: created successfully Jul 27 13:13:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 37ca57e3-3e05-490a-a426-d7d95f35dabb: deleting Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 37ca57e3-3e05-490a-a426-d7d95f35dabb: deleting {{(pid=88202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-848c297c-1c5b-4f4f-8011-6a6b154ec872" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-848c297c-1c5b-4f4f-8011-6a6b154ec872" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Deleting offline snapshot 848c297c-1c5b-4f4f-8011-6a6b154ec872 of volume 7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] snapshot_file for this snap is: volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe22ce-323a-443b-af2f-c986a26c6845]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:48 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 Jul 27 13:13:48 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Flow 'volume_create_manager' (aa011753-e92c-417a-a162-cf0019325684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ba4985-f735-4f47-8c9f-c970964b33ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ba4985-f735-4f47-8c9f-c970964b33ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1319349898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f15811-e634-4a68-b4b6-342507883d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba4be2e56e042dc8a3285d03dc0c5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:49Z,use_quota=True,user_id='50312797a8a2475d836c7edfb90286b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a514d92-5fba-4b1d-8cd0-b38a371461eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a514d92-5fba-4b1d-8cd0-b38a371461eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5c90f4-339c-4f28-8e49-e8283584decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5c90f4-339c-4f28-8e49-e8283584decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f15811-e634-4a68-b4b6-342507883d77', 'volume_name': 'volume-18f15811-e634-4a68-b4b6-342507883d77', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe79b3d-6d8d-4296-904d-4f1bf23ee96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe79b3d-6d8d-4296-904d-4f1bf23ee96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec29209-b677-4d2c-b14b-46b60afc10e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:48 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Volume 18f15811-e634-4a68-b4b6-342507883d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f15811-e634-4a68-b4b6-342507883d77', 'volume_size': 1} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1319349898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f15811-e634-4a68-b4b6-342507883d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba4be2e56e042dc8a3285d03dc0c5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:49Z,use_quota=True,user_id='50312797a8a2475d836c7edfb90286b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Creating volume 18f15811-e634-4a68-b4b6-342507883d77 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:13:48 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:48 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 1073741824 Jul 27 13:13:48 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:48 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872" returned: 0 in 0.549s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[91478e35-88fa-448a-901c-05a503a66e11]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:49 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 Jul 27 13:13:49 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:49 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 1073741824" returned: 0 in 0.509s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:49 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 Jul 27 13:13:49 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:49 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" returned: 0 in 0.517s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:49 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 Jul 27 13:13:49 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:49 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77" returned: 0 in 0.388s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec29209-b677-4d2c-b14b-46b60afc10e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f15811-e634-4a68-b4b6-342507883d77', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cdee45-a061-4b62-beeb-ba92ccc93a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:49 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Volume volume-18f15811-e634-4a68-b4b6-342507883d77 (18f15811-e634-4a68-b4b6-342507883d77): created successfully Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cdee45-a061-4b62-beeb-ba92ccc93a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Flow 'volume_create_manager' (aa011753-e92c-417a-a162-cf0019325684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c1398dd1-fbbe-46b3-9ba5-386aa5105a24 tempest-ServersNegativeTestJSON-1439045472 None] Created volume successfully. Jul 27 13:13:49 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872" returned: 0 in 0.506s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:50 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872 Jul 27 13:13:50 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:50 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25.848c297c-1c5b-4f4f-8011-6a6b154ec872" returned: 0 in 0.295s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-848c297c-1c5b-4f4f-8011-6a6b154ec872" released by "_delete_snapshot" :: held 2.075s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" released by "delete_snapshot" :: held 2.132s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:50 devstack cinder-volume[88202]: WARNING cinder.quota [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-41749281 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-41749281, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:13:50 devstack cinder-volume[88202]: WARNING cinder.quota [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-41749281 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-41749281, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:13:50 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['7c3120c6-bfb2-468d-8fd3-f6f4b5d603fd', '07cd3340-1093-4c57-afd4-9cb4e570aaf3', 'ba4854a0-5db9-49be-9a32-9b9c8cd97b85', '36f18c1b-7b80-46a2-9d67-0f516b3fa3d0'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-29316b4c-c540-4e4d-88f0-7553bea51d73 tempest-GroupSnapshotsTest-1517296987 None] group_snapshot 37ca57e3-3e05-490a-a426-d7d95f35dabb: deleted successfully Jul 27 13:13:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "cinder-quobyte-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de2fa1b-47a1-4595-8551-c30fd7a4fda2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:51 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 Jul 27 13:13:51 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:52 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" returned: 0 in 0.681s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:52 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25 Jul 27 13:13:52 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:52 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" returned: 0 in 0.505s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Lock "cinder-quobyte-7ffb143e-1ae9-4f05-bfa4-f384a771fc25" released by "delete_volume" :: held 1.367s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Flow 'volume_create_manager' (9d518709-96a2-4ffd-b1cf-d35b966e4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec5eb5f-25dd-4e5e-8b3f-1d94d5e0cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec5eb5f-25dd-4e5e-8b3f-1d94d5e0cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1072499274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f915da-2812-44c9-8951-fe122f14514d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba4be2e56e042dc8a3285d03dc0c5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:53Z,use_quota=True,user_id='50312797a8a2475d836c7edfb90286b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1514a9a4-04d5-499e-ab65-b64a85e218ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1514a9a4-04d5-499e-ab65-b64a85e218ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb29315-5bf4-4877-83fd-c94db605d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb29315-5bf4-4877-83fd-c94db605d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f915da-2812-44c9-8951-fe122f14514d', 'volume_name': 'volume-64f915da-2812-44c9-8951-fe122f14514d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc129bbf-93fa-48cc-96a2-4d65a0bf2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc129bbf-93fa-48cc-96a2-4d65a0bf2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d385449-abd0-4203-9a14-52484984d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Volume 64f915da-2812-44c9-8951-fe122f14514d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f915da-2812-44c9-8951-fe122f14514d', 'volume_size': 1} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1072499274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f915da-2812-44c9-8951-fe122f14514d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba4be2e56e042dc8a3285d03dc0c5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:13:53Z,use_quota=True,user_id='50312797a8a2475d836c7edfb90286b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Creating volume 64f915da-2812-44c9-8951-fe122f14514d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:13:52 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:52 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d 1073741824 Jul 27 13:13:52 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:52 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['08afaf2f-40da-4344-84fc-ee12f12b023b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:53 devstack cinder-volume[88202]: WARNING cinder.quota [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-41749281 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-41749281, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Created reservations ['3f849bff-3b28-4582-a908-9165174754be', '3faf6ffa-1980-4959-b6f1-b89ea6219578', '1ec10a9b-7d77-4557-a96c-749774d5fb95', 'cddb7571-3024-481e-9cea-937fb5d28310'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:53 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:13:53 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:53 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d 1073741824" returned: 0 in 0.559s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:53 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.295s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8c286477-a15b-4fce-bd91-d463a6ecd26c tempest-GroupSnapshotsTest-1517296987 None] Delete group completed successfully. Jul 27 13:13:53 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d Jul 27 13:13:53 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:53 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d385449-abd0-4203-9a14-52484984d802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f915da-2812-44c9-8951-fe122f14514d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175ab072-bf1d-4601-8420-7ff697e59271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:13:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Volume volume-64f915da-2812-44c9-8951-fe122f14514d (64f915da-2812-44c9-8951-fe122f14514d): created successfully Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175ab072-bf1d-4601-8420-7ff697e59271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:13:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Flow 'volume_create_manager' (9d518709-96a2-4ffd-b1cf-d35b966e4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:13:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-65c00b1b-44f5-4271-ae9b-b3e0976f0254 tempest-ServersNegativeTestJSON-1439045472 None] Created volume successfully. Jul 27 13:13:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "cinder-64f915da-2812-44c9-8951-fe122f14514d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-64f915da-2812-44c9-8951-fe122f14514d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "cinder-quobyte-64f915da-2812-44c9-8951-fe122f14514d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-quobyte-64f915da-2812-44c9-8951-fe122f14514d" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:55 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b003a8d-3e36-4f30-85c2-1e9e937168cd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:55 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d Jul 27 13:13:55 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:56 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d" returned: 0 in 0.423s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:56 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d Jul 27 13:13:56 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:56 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-64f915da-2812-44c9-8951-fe122f14514d" returned: 0 in 0.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-quobyte-64f915da-2812-44c9-8951-fe122f14514d" released by "delete_volume" :: held 0.782s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Created reservations ['e8b6ac11-d45e-45ce-b297-fd2663155c3e', '42aa6182-7b15-4086-85cd-1c1f2d973e6b', 'c8502678-ab28-4ef3-8198-aa6b8748694a', '35509b47-1fb2-40e0-bf39-a5c381574c73'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:56 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:13:56 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "cinder-18f15811-e634-4a68-b4b6-342507883d77-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-18f15811-e634-4a68-b4b6-342507883d77-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "cinder-quobyte-18f15811-e634-4a68-b4b6-342507883d77" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-quobyte-18f15811-e634-4a68-b4b6-342507883d77" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:13:56 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.373s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:56 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Deleted volume successfully. Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2344e20-f75e-45e3-904d-384e553588e1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de01fb55-158d-4f68-919d-3aa21b67e962 tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-64f915da-2812-44c9-8951-fe122f14514d-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:57 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 Jul 27 13:13:57 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:57 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77" returned: 0 in 0.432s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:57 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77 Jul 27 13:13:57 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:57 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-18f15811-e634-4a68-b4b6-342507883d77" returned: 0 in 0.259s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-quobyte-18f15811-e634-4a68-b4b6-342507883d77" released by "delete_volume" :: held 0.786s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Created reservations ['e8052620-4ce5-408c-8012-39bffdbc8e39', '749ddd51-cbf9-4922-aa31-8893158c115b', '6351192f-cdc7-4859-9a65-adae595e83cc', '5f62e0ee-1a77-4b9c-9deb-926846234657'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:13:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:13:57 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:13:57 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:13:58 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 27 13:13:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.386s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:13:58 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:13:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Deleted volume successfully. Jul 27 13:13:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0b9a2f0-23f0-4e02-b6fe-0945b388201d tempest-ServersNegativeTestJSON-1439045472 None] Lock "cinder-18f15811-e634-4a68-b4b6-342507883d77-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-621465f7-8b47-4738-8c8f-025770109d82 tempest-GroupSnapshotsV319Test-1532104691 None] Group tempest-GroupSnapshotsV319Test-Group-2134878145: creating Jul 27 13:14:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-621465f7-8b47-4738-8c8f-025770109d82 tempest-GroupSnapshotsV319Test-1532104691 None] Group tempest-GroupSnapshotsV319Test-Group-2134878145: created successfully Jul 27 13:14:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-621465f7-8b47-4738-8c8f-025770109d82 tempest-GroupSnapshotsV319Test-1532104691 None] Create group completed successfully. Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Flow 'volume_create_manager' (ea647eb0-302f-4fe4-a94a-d12e1ab3e465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab0272a-4942-4b49-ae68-200e09cdbab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab0272a-4942-4b49-ae68-200e09cdbab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848360357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da05c2f2-4d3c-4fc6-aa27-c84ab9130e53,host='devstack@QuobyteHD#QuobyteHD',id=7a9d69df-9107-48f3-86dd-9079d974aa68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b53e5a688f141aab1b7b885be061b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:02Z,use_quota=True,user_id='c013ad1a4ee24c6486ce33f4edc7bb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce1d5034-92bb-4653-b8c9-8f85df00dcfa),volume_type_id=ce1d5034-92bb-4653-b8c9-8f85df00dcfa)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff60622-3825-4b19-bd67-0b741da61c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff60622-3825-4b19-bd67-0b741da61c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a7f6c9-a698-4abe-b781-8cb14c162ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a7f6c9-a698-4abe-b781-8cb14c162ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9d69df-9107-48f3-86dd-9079d974aa68', 'volume_name': 'volume-7a9d69df-9107-48f3-86dd-9079d974aa68', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009147d3-a8d8-4795-85e6-fcd3dae118f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009147d3-a8d8-4795-85e6-fcd3dae118f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c3683a-25d5-45ea-885e-3a8a1ccde5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:02 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Volume 7a9d69df-9107-48f3-86dd-9079d974aa68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9d69df-9107-48f3-86dd-9079d974aa68', 'volume_size': 1} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da05c2f2-4d3c-4fc6-aa27-c84ab9130e53,created_at=2026-07-27T11:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848360357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da05c2f2-4d3c-4fc6-aa27-c84ab9130e53,host='devstack@QuobyteHD#QuobyteHD',id=7a9d69df-9107-48f3-86dd-9079d974aa68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b53e5a688f141aab1b7b885be061b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:02Z,use_quota=True,user_id='c013ad1a4ee24c6486ce33f4edc7bb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce1d5034-92bb-4653-b8c9-8f85df00dcfa),volume_type_id=ce1d5034-92bb-4653-b8c9-8f85df00dcfa)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Creating volume 7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:14:02 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:14:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:02 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 1073741824 Jul 27 13:14:02 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:03 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 1073741824" returned: 0 in 0.639s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:03 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 Jul 27 13:14:03 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:03 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68" returned: 0 in 0.387s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c3683a-25d5-45ea-885e-3a8a1ccde5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9d69df-9107-48f3-86dd-9079d974aa68', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdd9925-b265-4d81-aa0a-32d4be910d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Volume volume-7a9d69df-9107-48f3-86dd-9079d974aa68 (7a9d69df-9107-48f3-86dd-9079d974aa68): created successfully Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdd9925-b265-4d81-aa0a-32d4be910d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Flow 'volume_create_manager' (ea647eb0-302f-4fe4-a94a-d12e1ab3e465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c3ee3b3c-96de-4fa1-892f-34472fd52046 tempest-GroupSnapshotsV319Test-1532104691 None] Created volume successfully. Jul 27 13:14:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] GroupSnapshot 39668023-4e66-449f-88d3-14bed6d3bf53: creating. Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=115,cinder:INSERT=22,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=118,cinder:UPDATE=119,cinder:DELETE=4,cinder:INSERT=26 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Group snapshot 39668023-4e66-449f-88d3-14bed6d3bf53: creating. {{(pid=88202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Creating offline snapshot b7b96519-93d4-4e2b-bfc7-268f3d260e48 of volume 7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fac5583-78cc-48bf-8624-a42aab4f265a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:05 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 Jul 27 13:14:05 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:05 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68" returned: 0 in 0.592s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:05 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 1G Jul 27 13:14:05 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:06 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 1G" returned: 0 in 0.690s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a9d69df-9107-48f3-86dd-9079d974aa68 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:06 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a9d69df-9107-48f3-86dd-9079d974aa68 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 Jul 27 13:14:06 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-1417f4f3-2aa5-46cd-9aea-5ad02f295e85 req-0a68fa86-79d5-494a-9253-1ff4b2fdd5c6 tempest-ServerActionsTestOtherA-1977739147 None] Terminate volume connection completed successfully. Jul 27 13:14:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-1417f4f3-2aa5-46cd-9aea-5ad02f295e85 req-0a68fa86-79d5-494a-9253-1ff4b2fdd5c6 tempest-ServerActionsTestOtherA-1977739147 None] Deleting attachment 9168b1fa-5470-4a30-9cc9-7c526dd4a42e. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:14:06 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a9d69df-9107-48f3-86dd-9079d974aa68 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48" returned: 0 in 0.450s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:06 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:14:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:06 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 Jul 27 13:14:06 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:07 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48" returned: 0 in 0.394s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:07 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info Jul 27 13:14:07 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:07 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info" returned: 0 in 0.444s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:07 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:14:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:07 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info Jul 27 13:14:07 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:08 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.info" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9c3a5895-bf8f-4776-ac15-c8efa4b66ce5 tempest-GroupSnapshotsV319Test-1532104691 None] group_snapshot 39668023-4e66-449f-88d3-14bed6d3bf53: created successfully Jul 27 13:14:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] group_snapshot 39668023-4e66-449f-88d3-14bed6d3bf53: deleting Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] group_snapshot 39668023-4e66-449f-88d3-14bed6d3bf53: deleting {{(pid=88202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "cinder-quobyte-7a9d69df-9107-48f3-86dd-9079d974aa68" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "cinder-quobyte-7a9d69df-9107-48f3-86dd-9079d974aa68" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "cinder-quobyte-b7b96519-93d4-4e2b-bfc7-268f3d260e48" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "cinder-quobyte-b7b96519-93d4-4e2b-bfc7-268f3d260e48" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Deleting offline snapshot b7b96519-93d4-4e2b-bfc7-268f3d260e48 of volume 7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] snapshot_file for this snap is: volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae6738-4682-4498-97ce-87c635a28c57]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Flow 'volume_create_manager' (8dca4df9-79e5-4cf8-a909-9b0cad301fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd6cb36-3777-4fe0-a998-4035226b93f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd6cb36-3777-4fe0-a998-4035226b93f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-296440585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d330fc87-283c-4ae5-8a68-e2f0435554cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abdd434b1c4441882f1d191f5e36cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:10Z,use_quota=True,user_id='6160daa58bd24d31895f0b846a7318a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b8fbf9-ea3e-4f35-8125-b36c0c708aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b8fbf9-ea3e-4f35-8125-b36c0c708aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bf9c4c-37c7-422c-b737-cfe80dd4d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bf9c4c-37c7-422c-b737-cfe80dd4d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd330fc87-283c-4ae5-8a68-e2f0435554cb', 'volume_name': 'volume-d330fc87-283c-4ae5-8a68-e2f0435554cb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49aa931a-afd9-4b17-accf-94bbfe18c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49aa931a-afd9-4b17-accf-94bbfe18c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803cf93a-3c63-484b-87c7-9c12d0eb0b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Volume d330fc87-283c-4ae5-8a68-e2f0435554cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d330fc87-283c-4ae5-8a68-e2f0435554cb', 'volume_size': 1} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-296440585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d330fc87-283c-4ae5-8a68-e2f0435554cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abdd434b1c4441882f1d191f5e36cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:10Z,use_quota=True,user_id='6160daa58bd24d31895f0b846a7318a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Creating volume d330fc87-283c-4ae5-8a68-e2f0435554cb {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:14:10 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:10 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb 1073741824 Jul 27 13:14:10 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:10 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 Jul 27 13:14:10 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:10 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48" returned: 0 in 0.515s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a9d69df-9107-48f3-86dd-9079d974aa68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538b9c7-a928-49e3-9582-8f97f5c0a447]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:10 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 Jul 27 13:14:10 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:10 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb 1073741824" returned: 0 in 0.570s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:11 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb Jul 27 13:14:11 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:11 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:11 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb" returned: 0 in 0.411s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:11 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 Jul 27 13:14:11 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803cf93a-3c63-484b-87c7-9c12d0eb0b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d330fc87-283c-4ae5-8a68-e2f0435554cb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6964e1b6-f704-4509-a300-1566ab3dd18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:11 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Volume volume-d330fc87-283c-4ae5-8a68-e2f0435554cb (d330fc87-283c-4ae5-8a68-e2f0435554cb): created successfully Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6964e1b6-f704-4509-a300-1566ab3dd18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Flow 'volume_create_manager' (8dca4df9-79e5-4cf8-a909-9b0cad301fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d0fe277d-31f4-4967-b487-f330ef4281ee tempest-TaggedAttachmentsTest-1288421795 None] Created volume successfully. Jul 27 13:14:11 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:11 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48 Jul 27 13:14:11 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:12 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68.b7b96519-93d4-4e2b-bfc7-268f3d260e48" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "cinder-quobyte-b7b96519-93d4-4e2b-bfc7-268f3d260e48" released by "_delete_snapshot" :: held 1.914s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Lock "cinder-quobyte-7a9d69df-9107-48f3-86dd-9079d974aa68" released by "delete_snapshot" :: held 1.954s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:12 devstack cinder-volume[88202]: WARNING cinder.quota [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2144290584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2144290584, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:14:12 devstack cinder-volume[88202]: WARNING cinder.quota [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2144290584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2144290584, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] Created reservations ['4028f6b5-b688-412c-ac92-2b7209299210', '279cdfa4-25e8-4ce0-b864-7c2c02431326', '02694ae3-d280-496f-9074-da7f3a1b2124', '0544f35c-812e-43f1-8b85-e66d8cb9c3cc'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:14:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ef29f36b-a300-49ff-b368-b1b14abeda26 tempest-GroupSnapshotsV319Test-1532104691 None] group_snapshot 39668023-4e66-449f-88d3-14bed6d3bf53: deleted successfully Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "cinder-quobyte-7a9d69df-9107-48f3-86dd-9079d974aa68" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Lock "cinder-quobyte-7a9d69df-9107-48f3-86dd-9079d974aa68" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f180180-1dac-4937-b967-995290e32b03]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:13 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 Jul 27 13:14:13 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:13 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:13 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68 Jul 27 13:14:13 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:13 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7a9d69df-9107-48f3-86dd-9079d974aa68" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Lock "cinder-quobyte-7a9d69df-9107-48f3-86dd-9079d974aa68" released by "delete_volume" :: held 0.842s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Created reservations ['042a69f6-f6dd-4a83-b9bf-5898e60463f8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:14:13 devstack cinder-volume[88202]: WARNING cinder.quota [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2144290584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2144290584, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Created reservations ['40303c58-b6e6-4d8f-a999-60b95435136c', 'f112eb38-d749-473e-8592-7e9cbb456993', 'af1e34c4-f0fc-45e1-b5af-072896b17875', '7e8adf8e-6a29-48f5-b686-5c5c6b8129fe'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:13 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:14:13 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:14 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.381s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:14 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:14:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8a7ec75b-3510-4a34-ba71-f53a73770e7e tempest-GroupSnapshotsV319Test-1532104691 None] Delete group completed successfully. Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "cinder-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Lock "cinder-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "cinder-quobyte-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Lock "cinder-quobyte-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbf5fdf-05e3-44da-a7af-8ff255e7b5a1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:15 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b Jul 27 13:14:15 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:15 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b" returned: 0 in 0.413s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:15 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b Jul 27 13:14:15 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:15 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b" returned: 0 in 0.302s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Lock "cinder-quobyte-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b" released by "delete_volume" :: held 0.782s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:15 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Created reservations ['47cda4c5-956a-49d6-bbf8-626ceb5d99a1', 'a88a3544-b759-4af0-9ff8-b2fee86aafe9', '25753dca-8348-4b72-824b-3dd399b2a8e0', 'b4417480-4257-4ee3-8715-8a6db9fe61b8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:16 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:14:16 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:16 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.351s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:14:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Deleted volume successfully. Jul 27 13:14:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-310b683d-de3f-4bae-9505-ab55b68d5404 tempest-ServerActionsTestOtherA-1977739147 None] Lock "cinder-4c2a97f0-abd3-4aa1-bee4-b99b03cc8c9b-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:26 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=30,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:14:26 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Flow 'volume_create_manager' (3c7e4b93-d9f5-4c52-a5e2-ac156fd3deff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062ac8bd-7fab-4d1c-baea-3e9bd14bc62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062ac8bd-7fab-4d1c-baea-3e9bd14bc62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1689950133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11ad888-c0d4-438a-9360-9eb4f729afb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71509871fb554937bdfe266a61567fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:31Z,use_quota=True,user_id='69742dce82f3486f8c83ae877d197ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de225239-f442-4667-9af5-b88d4650b234),volume_type_id=de225239-f442-4667-9af5-b88d4650b234)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca0401f-f55b-4cba-91d4-7606e6f800c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca0401f-f55b-4cba-91d4-7606e6f800c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dfdf64-7259-490c-8109-c22053e68805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dfdf64-7259-490c-8109-c22053e68805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11ad888-c0d4-438a-9360-9eb4f729afb0', 'volume_name': 'volume-b11ad888-c0d4-438a-9360-9eb4f729afb0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29629ad9-29f8-4f98-b69f-ef635ea400ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29629ad9-29f8-4f98-b69f-ef635ea400ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b9e2f7-282c-47bf-9406-cd5147ad349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Volume b11ad888-c0d4-438a-9360-9eb4f729afb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11ad888-c0d4-438a-9360-9eb4f729afb0', 'volume_size': 1} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1689950133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11ad888-c0d4-438a-9360-9eb4f729afb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71509871fb554937bdfe266a61567fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:31Z,use_quota=True,user_id='69742dce82f3486f8c83ae877d197ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de225239-f442-4667-9af5-b88d4650b234),volume_type_id=de225239-f442-4667-9af5-b88d4650b234)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Creating volume b11ad888-c0d4-438a-9360-9eb4f729afb0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:14:30 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:14:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:30 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 1073741824 Jul 27 13:14:30 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:31 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 1073741824" returned: 0 in 0.743s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:31 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 Jul 27 13:14:31 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:31 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0" returned: 0 in 0.361s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:14:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b9e2f7-282c-47bf-9406-cd5147ad349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11ad888-c0d4-438a-9360-9eb4f729afb0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f67088-8af3-435c-952f-088107b162ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Volume volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 (b11ad888-c0d4-438a-9360-9eb4f729afb0): created successfully Jul 27 13:14:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f67088-8af3-435c-952f-088107b162ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Flow 'volume_create_manager' (3c7e4b93-d9f5-4c52-a5e2-ac156fd3deff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:32 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-be669e6a-78c8-4f6a-9939-2a43baf03c7a tempest-VolumeTypesAccessTest-1444880500 None] Created volume successfully. Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Acquiring lock "cinder-b11ad888-c0d4-438a-9360-9eb4f729afb0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Lock "cinder-b11ad888-c0d4-438a-9360-9eb4f729afb0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:33 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:14:33 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Acquiring lock "cinder-quobyte-b11ad888-c0d4-438a-9360-9eb4f729afb0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Lock "cinder-quobyte-b11ad888-c0d4-438a-9360-9eb4f729afb0" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8501cb6-ae0f-417c-9899-e9c1880a3cbc]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:33 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 Jul 27 13:14:33 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:33 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.856s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 8 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:14:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:14:34 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0" returned: 0 in 0.858s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:34 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0 Jul 27 13:14:34 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:34 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b11ad888-c0d4-438a-9360-9eb4f729afb0" returned: 0 in 0.337s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Lock "cinder-quobyte-b11ad888-c0d4-438a-9360-9eb4f729afb0" released by "delete_volume" :: held 1.275s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:34 devstack cinder-volume[88202]: WARNING cinder.quota [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1378975034 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1378975034, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:14:34 devstack cinder-volume[88202]: WARNING cinder.quota [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1378975034 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1378975034, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Created reservations ['ca6455ba-85cd-445d-aba7-8e214d2cbd0b', '850ad2f6-14f9-4930-8179-f0f86b8ac1b4', '680322e5-2cdb-4a04-bf32-92b34f1951a2', '8076fde8-e2b9-4a13-9967-65878d28b4fa'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:34 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:14:34 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:35 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.392s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:35 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:14:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Deleted volume successfully. Jul 27 13:14:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6223fb33-5c60-424c-930f-f595ee34259c tempest-VolumeTypesAccessTest-1444880500 None] Lock "cinder-b11ad888-c0d4-438a-9360-9eb4f729afb0-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:14:44 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:14:45 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Flow 'volume_create_manager' (23f58e43-3514-4475-82a3-d8d53feeee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d91dbd6-4536-4e2c-9393-217f3fc6d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d91dbd6-4536-4e2c-9393-217f3fc6d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-546565909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334463b0-40e5-430c-a09d-febd368e97b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4b124633ac4d58b0e36cb9124ba546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:53Z,use_quota=True,user_id='4fe784269ac247f7975b91136aea07e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d4cf1f-9548-489a-86c5-2486d68ec22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d4cf1f-9548-489a-86c5-2486d68ec22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f83e7c-e8ba-49cf-9609-ea52076671f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f83e7c-e8ba-49cf-9609-ea52076671f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334463b0-40e5-430c-a09d-febd368e97b6', 'volume_name': 'volume-334463b0-40e5-430c-a09d-febd368e97b6', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1da7b7-0daa-4673-977a-eefc404bc01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1da7b7-0daa-4673-977a-eefc404bc01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cf87da-84e4-4eed-a433-aca13517a78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Volume 334463b0-40e5-430c-a09d-febd368e97b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334463b0-40e5-430c-a09d-febd368e97b6', 'volume_size': 1} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-546565909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334463b0-40e5-430c-a09d-febd368e97b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4b124633ac4d58b0e36cb9124ba546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:14:53Z,use_quota=True,user_id='4fe784269ac247f7975b91136aea07e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Creating volume 334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:14:53 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:14:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:53 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 1073741824 Jul 27 13:14:53 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:54 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 1073741824" returned: 0 in 0.942s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:54 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 Jul 27 13:14:54 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:54 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6" returned: 0 in 0.501s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cf87da-84e4-4eed-a433-aca13517a78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334463b0-40e5-430c-a09d-febd368e97b6', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af4bb63-c5b6-424f-a2d8-6dec58cdb887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:14:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Volume volume-334463b0-40e5-430c-a09d-febd368e97b6 (334463b0-40e5-430c-a09d-febd368e97b6): created successfully Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af4bb63-c5b6-424f-a2d8-6dec58cdb887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:14:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Flow 'volume_create_manager' (23f58e43-3514-4475-82a3-d8d53feeee47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:14:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-28a796f1-bdd2-4593-8d92-33db98bc0a89 tempest-SnapshotMetadataTestJSON-800249478 None] Created volume successfully. Jul 27 13:14:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:14:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:14:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Creating offline snapshot 3ec98edc-c648-4ae2-9ec5-427f36d58886 of volume 334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:14:55 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece933d2-9cad-4f09-87af-5e4ae4660c55]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:14:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:56 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 Jul 27 13:14:56 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:56 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6" returned: 0 in 0.496s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:56 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 1G Jul 27 13:14:56 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:56 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 1G" returned: 0 in 0.497s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334463b0-40e5-430c-a09d-febd368e97b6 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:56 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334463b0-40e5-430c-a09d-febd368e97b6 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 Jul 27 13:14:56 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:57 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334463b0-40e5-430c-a09d-febd368e97b6 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886" returned: 0 in 0.386s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:57 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 is being set with open permissions: ugo+rw Jul 27 13:14:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:57 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 Jul 27 13:14:57 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:57 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:57 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info Jul 27 13:14:57 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:57 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:57 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info is being set with open permissions: ugo+rw Jul 27 13:14:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:14:57 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info Jul 27 13:14:57 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:14:58 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Jul 27 13:14:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.info" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:14:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:14:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-348c4534-dcfe-4497-a629-bcf0dd407297 tempest-SnapshotMetadataTestJSON-800249478 None] Create snapshot completed successfully Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "cinder-3ec98edc-c648-4ae2-9ec5-427f36d58886-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-3ec98edc-c648-4ae2-9ec5-427f36d58886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "cinder-quobyte-334463b0-40e5-430c-a09d-febd368e97b6" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-quobyte-334463b0-40e5-430c-a09d-febd368e97b6" acquired by "delete_snapshot" :: waited 0.068s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "cinder-quobyte-3ec98edc-c648-4ae2-9ec5-427f36d58886" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-quobyte-3ec98edc-c648-4ae2-9ec5-427f36d58886" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Deleting offline snapshot 3ec98edc-c648-4ae2-9ec5-427f36d58886 of volume 334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] snapshot_file for this snap is: volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e09cb-558c-4d80-9748-583986525757]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:01 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 Jul 27 13:15:01 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:01 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886" returned: 0 in 1.042s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334463b0-40e5-430c-a09d-febd368e97b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:15:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1c7e6a-456d-4543-9ef3-35cc1d6e8c7b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:02 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 Jul 27 13:15:02 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:03 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6" returned: 0 in 1.112s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:03 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 Jul 27 13:15:03 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:03 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886" returned: 0 in 0.892s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:04 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886 Jul 27 13:15:04 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:04 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6.3ec98edc-c648-4ae2-9ec5-427f36d58886" returned: 0 in 0.959s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-quobyte-3ec98edc-c648-4ae2-9ec5-427f36d58886" released by "_delete_snapshot" :: held 4.465s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-quobyte-334463b0-40e5-430c-a09d-febd368e97b6" released by "delete_snapshot" :: held 4.612s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:05 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Created reservations ['1756e3a8-acc6-4157-9f30-450c5701ed41', 'e1dc7730-bb11-48dd-88c6-7fd1bad3c904', '8dff95ca-bdce-4367-a25b-b74d3c4482d1', '0a118b56-2b59-4774-b810-2427003d6439'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Delete snapshot completed successfully. Jul 27 13:15:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3202b1f-9f33-425f-af4b-679657f07d69 tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-3ec98edc-c648-4ae2-9ec5-427f36d58886-delete_snapshot" released by "delete_snapshot" :: held 5.216s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "cinder-334463b0-40e5-430c-a09d-febd368e97b6-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Flow 'volume_create_manager' (5e33069f-0895-4c01-9d57-2b2ebc6eede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becf748a-310d-4b9e-9da3-c4b0180c926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-334463b0-40e5-430c-a09d-febd368e97b6-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becf748a-310d-4b9e-9da3-c4b0180c926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-618759381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976d3399-187c-4ca0-8f36-2aa81019cbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483ccd4cc5c4bc2a5d966a2f6e6f2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:06Z,use_quota=True,user_id='da057b480db2459096b3ed37b634fdc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d19939-3499-4bae-ab58-0b2a40a2f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d19939-3499-4bae-ab58-0b2a40a2f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99bbc28-e77c-4e09-ab86-c32893b28f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99bbc28-e77c-4e09-ab86-c32893b28f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976d3399-187c-4ca0-8f36-2aa81019cbf2', 'volume_name': 'volume-976d3399-187c-4ca0-8f36-2aa81019cbf2', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4830ae14-a540-40d9-a59d-628a6271d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4830ae14-a540-40d9-a59d-628a6271d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b0c14c-7150-429a-a657-8476b98b6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:06 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Volume 976d3399-187c-4ca0-8f36-2aa81019cbf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976d3399-187c-4ca0-8f36-2aa81019cbf2', 'volume_size': 1} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-618759381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976d3399-187c-4ca0-8f36-2aa81019cbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483ccd4cc5c4bc2a5d966a2f6e6f2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:06Z,use_quota=True,user_id='da057b480db2459096b3ed37b634fdc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Creating volume 976d3399-187c-4ca0-8f36-2aa81019cbf2 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:15:06 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:06 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 1073741824 Jul 27 13:15:06 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "cinder-quobyte-334463b0-40e5-430c-a09d-febd368e97b6" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-quobyte-334463b0-40e5-430c-a09d-febd368e97b6" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518b04a-8854-4b54-8a10-6a444235c488]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:07 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 Jul 27 13:15:07 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:07 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 1073741824" returned: 0 in 0.792s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:07 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 Jul 27 13:15:07 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:07 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6" returned: 0 in 0.721s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:07 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6 Jul 27 13:15:07 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-cf83cbf3-cf18-4495-ac39-c5d955524be6 req-5ea7c075-5e7f-4d9d-9ec2-c236eb973de3 tempest-TaggedAttachmentsTest-1288421795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:08 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-334463b0-40e5-430c-a09d-febd368e97b6" returned: 0 in 0.417s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:08 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2" returned: 0 in 0.512s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-quobyte-334463b0-40e5-430c-a09d-febd368e97b6" released by "delete_volume" :: held 1.257s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-cf83cbf3-cf18-4495-ac39-c5d955524be6 req-5ea7c075-5e7f-4d9d-9ec2-c236eb973de3 tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.165s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b0c14c-7150-429a-a657-8476b98b6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976d3399-187c-4ca0-8f36-2aa81019cbf2', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fd366a-0cbd-4656-ac79-19ed1fa1d510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Volume volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 (976d3399-187c-4ca0-8f36-2aa81019cbf2): created successfully Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fd366a-0cbd-4656-ac79-19ed1fa1d510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Flow 'volume_create_manager' (5e33069f-0895-4c01-9d57-2b2ebc6eede8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-cf83cbf3-cf18-4495-ac39-c5d955524be6 req-5ea7c075-5e7f-4d9d-9ec2-c236eb973de3 tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.180s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b65b88ad-4bdb-4fc2-9bac-9ef2e1f14561 tempest-AttachVolumeShelveTestJSON-1727001988 None] Created volume successfully. Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Created reservations ['0836ddcd-0d1c-432c-bb9d-f20406121250', '6070f6b8-ab9a-4730-85e6-e074384d5e96', '980fa7ea-ea2c-4c14-bcbe-fedb8e3d689e', '497e6111-103a-4c74-81b6-88c11ac148bc'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-cf83cbf3-cf18-4495-ac39-c5d955524be6 req-5ea7c075-5e7f-4d9d-9ec2-c236eb973de3 tempest-TaggedAttachmentsTest-1288421795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-d330fc87-283c-4ae5-8a68-e2f0435554cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cab6603c-0617-43a9-9bf0-23c26f709f1a', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:08 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:15:08 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-cf83cbf3-cf18-4495-ac39-c5d955524be6 req-5ea7c075-5e7f-4d9d-9ec2-c236eb973de3 tempest-TaggedAttachmentsTest-1288421795 None] attachment_update completed successfully. Jul 27 13:15:08 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.503s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:08 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:15:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Deleted volume successfully. Jul 27 13:15:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d7a7689-548a-4e0a-942f-c849def6cbdd tempest-SnapshotMetadataTestJSON-800249478 None] Lock "cinder-334463b0-40e5-430c-a09d-febd368e97b6-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-1c68635a-5616-410b-8670-07e35eae418c req-2e03b54c-a535-4d11-8efc-55da79f22dc0 tempest-TaggedAttachmentsTest-1288421795 None] Terminate volume connection completed successfully. Jul 27 13:15:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-1c68635a-5616-410b-8670-07e35eae418c req-2e03b54c-a535-4d11-8efc-55da79f22dc0 tempest-TaggedAttachmentsTest-1288421795 None] Deleting attachment cab6603c-0617-43a9-9bf0-23c26f709f1a. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Flow 'volume_create_manager' (d3bad142-b8c7-4e71-a33a-28afef43c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8a2fa3-2e4b-4fca-bf65-10af64811fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8a2fa3-2e4b-4fca-bf65-10af64811fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-662389894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ab9567-f457-4575-abe3-f97e54c2791d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfa2ee730624907b99c87ef101dc410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:21Z,use_quota=True,user_id='a11b381c891249389924b46816a982e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf340ac-f10d-4d66-a658-91ed6212707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf340ac-f10d-4d66-a658-91ed6212707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04a2b2a-9955-4f88-a4df-d5f6bc6bb18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04a2b2a-9955-4f88-a4df-d5f6bc6bb18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ab9567-f457-4575-abe3-f97e54c2791d', 'volume_name': 'volume-60ab9567-f457-4575-abe3-f97e54c2791d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8194bf2b-bfcc-4e25-8320-b920c58d642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8194bf2b-bfcc-4e25-8320-b920c58d642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e11fcb-775d-4e39-af7f-4dbd267193b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:20 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Volume 60ab9567-f457-4575-abe3-f97e54c2791d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ab9567-f457-4575-abe3-f97e54c2791d', 'volume_size': 1} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-662389894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ab9567-f457-4575-abe3-f97e54c2791d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfa2ee730624907b99c87ef101dc410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:21Z,use_quota=True,user_id='a11b381c891249389924b46816a982e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Creating volume 60ab9567-f457-4575-abe3-f97e54c2791d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:15:20 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:15:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:20 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d 1073741824 Jul 27 13:15:20 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:21 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d 1073741824" returned: 0 in 0.752s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:21 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d Jul 27 13:15:21 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:22 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d" returned: 0 in 0.796s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e11fcb-775d-4e39-af7f-4dbd267193b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ab9567-f457-4575-abe3-f97e54c2791d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa55462b-9808-48a8-87f4-9bb3adc0dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:22 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Volume volume-60ab9567-f457-4575-abe3-f97e54c2791d (60ab9567-f457-4575-abe3-f97e54c2791d): created successfully Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa55462b-9808-48a8-87f4-9bb3adc0dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Flow 'volume_create_manager' (d3bad142-b8c7-4e71-a33a-28afef43c957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f0ca51b4-9119-4675-9761-5daf8687ddc8 tempest-ServerRescueNegativeTestJSON-854276917 None] Created volume successfully. Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Flow 'volume_create_manager' (b63fa165-2fe4-4baf-ac11-27aed5386ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc747f74-945c-4815-91b6-3ca95af31894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc747f74-945c-4815-91b6-3ca95af31894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1344699149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e8217-80a6-4b23-94c1-2c6eb62ca7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fce85804a34c9ca0890a401d929009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:23Z,use_quota=True,user_id='d195baa7eb4f49838f382f97d5f2f62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454b71b1-c1a3-4eb9-b33f-22f407d285f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454b71b1-c1a3-4eb9-b33f-22f407d285f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9062ae-5b67-4ce5-83be-b96c16c7e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9062ae-5b67-4ce5-83be-b96c16c7e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513e8217-80a6-4b23-94c1-2c6eb62ca7fc', 'volume_name': 'volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6e5cc2-1b85-41ba-88b6-19f2adac6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6e5cc2-1b85-41ba-88b6-19f2adac6f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347399e2-28d5-4ed6-bf98-55f8c56078d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:23 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Volume 513e8217-80a6-4b23-94c1-2c6eb62ca7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc', 'volume_size': 1} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1344699149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e8217-80a6-4b23-94c1-2c6eb62ca7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fce85804a34c9ca0890a401d929009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:23Z,use_quota=True,user_id='d195baa7eb4f49838f382f97d5f2f62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Creating volume 513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:15:23 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:23 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc 1073741824 Jul 27 13:15:23 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:23 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc 1073741824" returned: 0 in 0.716s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:23 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc Jul 27 13:15:23 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:24 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" returned: 0 in 0.633s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347399e2-28d5-4ed6-bf98-55f8c56078d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab1383-62c4-4520-be19-9aee3ede8214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Volume volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc (513e8217-80a6-4b23-94c1-2c6eb62ca7fc): created successfully Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab1383-62c4-4520-be19-9aee3ede8214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Flow 'volume_create_manager' (b63fa165-2fe4-4baf-ac11-27aed5386ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e23d7b08-491f-4501-a888-8b395d76f189 tempest-VolumesDeleteCascade-663171339 None] Created volume successfully. Jul 27 13:15:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Creating offline snapshot ac6bb583-a9d9-4e45-bcbf-009e7a26e695 of volume 513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:15:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a718b7-714b-4c6b-9815-17efc1076667]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:26 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc Jul 27 13:15:26 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:26 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" returned: 0 in 0.870s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:26 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 1G Jul 27 13:15:26 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:27 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 1G" returned: 0 in 1.021s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:27 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:27 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:28 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.660s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:28 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 is being set with open permissions: ugo+rw Jul 27 13:15:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:28 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:28 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-2043c587-13ac-4fb8-8fb2-390a63ee1a61 req-e366a520-c2b2-405f-ad77-ebc81c622de6 tempest-AttachVolumeShelveTestJSON-1727001988 None] No connector for attachment 170f5649-c06e-4ea9-a2e7-33affa724769; skipping storage backend terminate_connection call. {{(pid=88202) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 27 13:15:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-2043c587-13ac-4fb8-8fb2-390a63ee1a61 req-e366a520-c2b2-405f-ad77-ebc81c622de6 tempest-AttachVolumeShelveTestJSON-1727001988 None] Deleting attachment 170f5649-c06e-4ea9-a2e7-33affa724769. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:15:28 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.525s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:29 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info Jul 27 13:15:29 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:29 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info" returned: 0 in 0.562s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:29 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info is being set with open permissions: ugo+rw Jul 27 13:15:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:29 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info Jul 27 13:15:29 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:29 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.info" returned: 0 in 0.454s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.283s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0d4ce107-1841-40b4-a559-2ebf4c3f3c8d tempest-VolumesDeleteCascade-663171339 None] Create snapshot completed successfully Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Acquiring lock "cinder-d330fc87-283c-4ae5-8a68-e2f0435554cb-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Lock "cinder-d330fc87-283c-4ae5-8a68-e2f0435554cb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Acquiring lock "cinder-quobyte-d330fc87-283c-4ae5-8a68-e2f0435554cb" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Lock "cinder-quobyte-d330fc87-283c-4ae5-8a68-e2f0435554cb" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd10a77-fab3-4891-93ed-7e19312b7a74]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:30 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb Jul 27 13:15:30 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:31 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb" returned: 0 in 0.517s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:31 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb Jul 27 13:15:31 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Creating offline snapshot 6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 of volume 513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:15:31 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d330fc87-283c-4ae5-8a68-e2f0435554cb" returned: 0 in 0.522s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Lock "cinder-quobyte-d330fc87-283c-4ae5-8a68-e2f0435554cb" released by "delete_volume" :: held 1.090s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94ce966-6a31-46a3-8422-8c5c87c781ec]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Created reservations ['36ca57ae-5982-4d80-a522-b5c62e470fb7', 'aa9fdf28-ad41-4814-b8ba-297e2151748a', 'c24310d5-7237-4f44-b26f-622e7e640f65', '50db8ffe-79ca-48eb-8fb6-0c2f24c0be33'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:31 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:31 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:31 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:15:31 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:32 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:15:32 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Deleted volume successfully. Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f272a3-663f-4446-a920-3efdfa37f6bd tempest-TaggedAttachmentsTest-1288421795 None] Lock "cinder-d330fc87-283c-4ae5-8a68-e2f0435554cb-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:32 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.560s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:32 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 1G Jul 27 13:15:32 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:32 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 1G" returned: 0 in 0.754s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:32 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 Jul 27 13:15:32 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:33 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:15:33 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:33 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" returned: 0 in 0.534s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:33 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 is being set with open permissions: ugo+rw Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:33 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 Jul 27 13:15:33 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:33 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.612s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:15:33 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" returned: 0 in 0.357s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-24678ee7-7eb8-4cba-b1ab-f298c2fe1dd8 tempest-VolumesDeleteCascade-663171339 None] Create snapshot completed successfully Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-513e8217-80a6-4b23-94c1-2c6eb62ca7fc-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-513e8217-80a6-4b23-94c1-2c6eb62ca7fc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Performing cascade delete. {{(pid=88202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Deleting offline snapshot 6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 of volume 513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] snapshot_file for this snap is: volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b5d2b-f4b0-4f39-b78a-41fb4eee3c95]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:35 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 Jul 27 13:15:35 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:35 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" returned: 0 in 0.507s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:15:35 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09904b8-757f-4025-bbf7-6c99f04fd6b7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:35 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:35 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:36 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.715s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:15:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:36 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 Jul 27 13:15:36 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:37 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" returned: 0 in 0.770s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:37 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10 Jul 27 13:15:37 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:37 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" returned: 0 in 0.355s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10" released by "_delete_snapshot" :: held 2.509s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" released by "delete_snapshot" :: held 2.539s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Created reservations ['560f9d8c-992d-497d-8675-cc622934f806', '2acdb696-366c-4684-8108-ea3f04375b26', '8ea5dbb6-3f17-4e7d-80e5-4c32ee78b55b', 'a7acc338-b4fe-493e-a3b5-2f1a46ea66bd'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Delete snapshot completed successfully. Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-6e80faf5-3e4e-4f8a-a2c8-e83db9b1ad10-delete_snapshot" released by "delete_snapshot" :: held 2.817s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-ac6bb583-a9d9-4e45-bcbf-009e7a26e695-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-ac6bb583-a9d9-4e45-bcbf-009e7a26e695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-ac6bb583-a9d9-4e45-bcbf-009e7a26e695" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-ac6bb583-a9d9-4e45-bcbf-009e7a26e695" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Deleting offline snapshot ac6bb583-a9d9-4e45-bcbf-009e7a26e695 of volume 513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] snapshot_file for this snap is: volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbecefb-a6cf-4d35-afd9-6b1e307f0e15]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:38 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:38 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:38 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.706s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:15:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3eed4-c4fa-402d-bc92-b8125ec8df63]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:38 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc Jul 27 13:15:38 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:39 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" returned: 0 in 0.663s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:39 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:39 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:39 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.531s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:39 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695 Jul 27 13:15:39 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Acquiring lock "cinder-60ab9567-f457-4575-abe3-f97e54c2791d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:40 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "cinder-60ab9567-f457-4575-abe3-f97e54c2791d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc.ac6bb583-a9d9-4e45-bcbf-009e7a26e695" returned: 0 in 0.513s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-ac6bb583-a9d9-4e45-bcbf-009e7a26e695" released by "_delete_snapshot" :: held 2.635s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" released by "delete_snapshot" :: held 2.677s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Acquiring lock "cinder-quobyte-60ab9567-f457-4575-abe3-f97e54c2791d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "cinder-quobyte-60ab9567-f457-4575-abe3-f97e54c2791d" acquired by "delete_volume" :: waited 0.066s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f6afe-0a55-43ec-bd28-8b256696362a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Created reservations ['313290cd-5be6-472f-b9bc-8e4e587b3753', 'fef8cc4b-53af-4851-9370-2e20213d7885', '0728d2f4-f930-43fa-ae21-ed1ba1f6364e', '2ad84210-7637-4eec-87ef-17ede88eae67'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Delete snapshot completed successfully. Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-ac6bb583-a9d9-4e45-bcbf-009e7a26e695-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Snapshots deleted, issuing volume delete {{(pid=88202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:40 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d Jul 27 13:15:40 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8848ed31-c181-40bc-91d5-1b633a58cced]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:41 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc Jul 27 13:15:41 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:41 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d" returned: 0 in 0.698s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:41 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d Jul 27 13:15:41 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:41 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" returned: 0 in 0.927s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:41 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-60ab9567-f457-4575-abe3-f97e54c2791d" returned: 0 in 0.566s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "cinder-quobyte-60ab9567-f457-4575-abe3-f97e54c2791d" released by "delete_volume" :: held 1.378s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:41 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc Jul 27 13:15:42 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Created reservations ['adf19e2d-77e6-42d8-a94d-237a0139445e', 'ed853f9c-8898-4297-9d50-f7d88e5af3e1', '24eb4b8d-f194-44c4-99b9-1e57a8b12cb9', 'f59e470a-a562-4480-af1e-84cb3bd8a47e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:42 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:15:42 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:42 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" returned: 0 in 0.558s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-513e8217-80a6-4b23-94c1-2c6eb62ca7fc" released by "delete_volume" :: held 1.651s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:42 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.432s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:15:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Deleted volume successfully. Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Created reservations ['a1fbff9b-73b0-4d2f-bf20-345440297713', '1f4867cf-c629-4d4b-b742-4ff7012627cd', 'c58ab153-3313-4248-830e-12b67d38b7d2', '07e41830-4d74-4ff2-9683-67c7b4ab8e32'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-521135f7-9515-4042-8044-5fc2ed3c4498 tempest-ServerRescueNegativeTestJSON-854276917 None] Lock "cinder-60ab9567-f457-4575-abe3-f97e54c2791d-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:42 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:15:42 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:43 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.633s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:43 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:15:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Deleted volume successfully. Jul 27 13:15:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3aafd457-ab45-47f5-8cf9-80c3f1fe8de9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-513e8217-80a6-4b23-94c1-2c6eb62ca7fc-delete_volume" released by "delete_volume" :: held 8.823s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:15:44 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:15:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Flow 'volume_create_manager' (58885406-047e-42e9-9581-9f04acdcd285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7171ad60-f2c0-41ed-9a73-b26dee3c3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:44 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=60,cinder:UPDATE=75,cinder:DELETE=6,cinder:INSERT=18 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:15:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7171ad60-f2c0-41ed-9a73-b26dee3c3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-3778186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111453bc-6196-49dd-9b7d-b7aeee902a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fce85804a34c9ca0890a401d929009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:45Z,use_quota=True,user_id='d195baa7eb4f49838f382f97d5f2f62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58b3217-0814-481e-b3a9-8533f5a96f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58b3217-0814-481e-b3a9-8533f5a96f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960d5173-c143-4165-8d9e-cf2101507ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960d5173-c143-4165-8d9e-cf2101507ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111453bc-6196-49dd-9b7d-b7aeee902a2d', 'volume_name': 'volume-111453bc-6196-49dd-9b7d-b7aeee902a2d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd1a2d6-9a59-4aeb-93c1-3c0dc1309f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd1a2d6-9a59-4aeb-93c1-3c0dc1309f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbc6421-5f2b-45e2-ab64-11aa6ec5f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:45 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Volume 111453bc-6196-49dd-9b7d-b7aeee902a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111453bc-6196-49dd-9b7d-b7aeee902a2d', 'volume_size': 1} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-3778186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111453bc-6196-49dd-9b7d-b7aeee902a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fce85804a34c9ca0890a401d929009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:45Z,use_quota=True,user_id='d195baa7eb4f49838f382f97d5f2f62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Creating volume 111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:15:45 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:15:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:45 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d 1073741824 Jul 27 13:15:45 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:46 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d 1073741824" returned: 0 in 1.202s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:46 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=60,cinder:SELECT=67,cinder:INSERT=16,cinder:DELETE=5 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:15:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:46 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:15:46 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:47 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.661s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbc6421-5f2b-45e2-ab64-11aa6ec5f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111453bc-6196-49dd-9b7d-b7aeee902a2d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef225e0-86e5-48d4-ad24-5f329a67e15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Volume volume-111453bc-6196-49dd-9b7d-b7aeee902a2d (111453bc-6196-49dd-9b7d-b7aeee902a2d): created successfully Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef225e0-86e5-48d4-ad24-5f329a67e15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Flow 'volume_create_manager' (58885406-047e-42e9-9581-9f04acdcd285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cfb614d6-85e7-4ddc-b849-8194d8736c88 tempest-VolumesDeleteCascade-663171339 None] Created volume successfully. Jul 27 13:15:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Creating offline snapshot b631e981-53d9-40fe-89da-bcfb77bdcf7b of volume 111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:15:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc29d0-5d5f-4fd8-8e0a-7b450fcc7fd7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:49 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:15:49 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:49 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.883s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:49 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b 1G Jul 27 13:15:49 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:50 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b 1G" returned: 0 in 0.620s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111453bc-6196-49dd-9b7d-b7aeee902a2d -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:50 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111453bc-6196-49dd-9b7d-b7aeee902a2d -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b Jul 27 13:15:50 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:51 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111453bc-6196-49dd-9b7d-b7aeee902a2d -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b" returned: 0 in 0.593s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:51 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b is being set with open permissions: ugo+rw Jul 27 13:15:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:51 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b Jul 27 13:15:51 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:51 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b" returned: 0 in 0.475s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:51 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info Jul 27 13:15:51 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:51 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info" returned: 0 in 0.330s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:51 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info is being set with open permissions: ugo+rw Jul 27 13:15:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:51 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info Jul 27 13:15:51 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:52 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.info" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.555s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-18c2b23a-3d31-4bfb-8b63-848442e35146 tempest-VolumesDeleteCascade-663171339 None] Create snapshot completed successfully Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Flow 'volume_create_manager' (2422ccdb-40be-44d2-8604-e4be3f7bad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ff1b1-91d0-4d0c-aaa8-5e737a2eb3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ff1b1-91d0-4d0c-aaa8-5e737a2eb3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1826473529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe509703-3148-4240-a3f4-cf062875ce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fce85804a34c9ca0890a401d929009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b631e981-53d9-40fe-89da-bcfb77bdcf7b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:54Z,use_quota=True,user_id='d195baa7eb4f49838f382f97d5f2f62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f39b7f-7031-4fe3-a686-b28b158a5484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f39b7f-7031-4fe3-a686-b28b158a5484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0335f43-84ec-4b8f-a822-f54f2ca51ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0335f43-84ec-4b8f-a822-f54f2ca51ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe509703-3148-4240-a3f4-cf062875ce40', 'volume_name': 'volume-fe509703-3148-4240-a3f4-cf062875ce40', 'volume_size': 1, 'snapshot_id': 'b631e981-53d9-40fe-89da-bcfb77bdcf7b'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7fb82e-f6e2-41dc-94c6-341d28c58494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7fb82e-f6e2-41dc-94c6-341d28c58494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185f8861-c98f-405d-b748-72cb72358cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Volume fe509703-3148-4240-a3f4-cf062875ce40: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe509703-3148-4240-a3f4-cf062875ce40', 'volume_size': 1, 'snapshot_id': 'b631e981-53d9-40fe-89da-bcfb77bdcf7b'} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-b631e981-53d9-40fe-89da-bcfb77bdcf7b-fe509703-3148-4240-a3f4-cf062875ce40" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-b631e981-53d9-40fe-89da-bcfb77bdcf7b-fe509703-3148-4240-a3f4-cf062875ce40" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Creating volume fe509703-3148-4240-a3f4-cf062875ce40 from snapshot b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-fe509703-3148-4240-a3f4-cf062875ce40" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-fe509703-3148-4240-a3f4-cf062875ce40" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] snapshot: b631e981-53d9-40fe-89da-bcfb77bdcf7b, volume: fe509703-3148-4240-a3f4-cf062875ce40, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d331e60d-b9db-43e4-9f01-4a3c299f48b2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:54 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b Jul 27 13:15:54 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Flow 'volume_create_manager' (986db896-f471-4dd1-a8a6-3f4b9d9cd914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9188f48d-2f52-48ef-8cbe-7db25e8c39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9188f48d-2f52-48ef-8cbe-7db25e8c39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664135085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f6a758-601d-4c29-a3d3-8ee6a416d2da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e7a7780f6794869b765624a3056c1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:55Z,use_quota=True,user_id='a569c1d9b91248d5989fbbb42d67d20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d418ac-9b19-4c51-a73a-e5cd963c6701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d418ac-9b19-4c51-a73a-e5cd963c6701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47580cf-c059-425c-b8b7-9f7b1bad17c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47580cf-c059-425c-b8b7-9f7b1bad17c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f6a758-601d-4c29-a3d3-8ee6a416d2da', 'volume_name': 'volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488c0844-87ee-4709-a9fe-4217a51b0c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488c0844-87ee-4709-a9fe-4217a51b0c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3666fb4f-2de3-4687-b709-d5914f6d0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:15:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Volume a8f6a758-601d-4c29-a3d3-8ee6a416d2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da', 'volume_size': 1} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b" returned: 0 in 0.546s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111453bc-6196-49dd-9b7d-b7aeee902a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67251bf-2a3c-4f08-991d-4719c8233fe7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:15:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:54 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:15:54 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:15:55 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 27 13:15:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.478s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:15:55 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:15:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:15:55 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 Jul 27 13:15:55 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:01 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40" returned: 0 in 6.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c1654-18d7-47e9-8ae5-678c03d5b4d3]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:01 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:16:01 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:02 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.546s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:16:02 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Converted 1024.00 MB image at 162.86 MB/s Jul 27 13:16:02 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 is being set with open permissions: ugo+rw Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:02 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 Jul 27 13:16:02 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:02 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40" returned: 0 in 0.251s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-fe509703-3148-4240-a3f4-cf062875ce40" released by "_copy_volume_from_snapshot" :: held 8.220s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-b631e981-53d9-40fe-89da-bcfb77bdcf7b-fe509703-3148-4240-a3f4-cf062875ce40" released by "_create_volume_from_snapshot" :: held 8.264s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.296s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.617s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664135085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f6a758-601d-4c29-a3d3-8ee6a416d2da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e7a7780f6794869b765624a3056c1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:15:55Z,use_quota=True,user_id='a569c1d9b91248d5989fbbb42d67d20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Creating volume a8f6a758-601d-4c29-a3d3-8ee6a416d2da {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:02 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:02 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da 1073741824 Jul 27 13:16:02 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185f8861-c98f-405d-b748-72cb72358cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe509703-3148-4240-a3f4-cf062875ce40', 'volume_size': 1, 'snapshot_id': 'b631e981-53d9-40fe-89da-bcfb77bdcf7b'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5113307e-008d-4814-b3a4-4eb25650eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:02 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Volume volume-fe509703-3148-4240-a3f4-cf062875ce40 (fe509703-3148-4240-a3f4-cf062875ce40): created successfully Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5113307e-008d-4814-b3a4-4eb25650eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Flow 'volume_create_manager' (2422ccdb-40be-44d2-8604-e4be3f7bad80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:02 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1b1afa05-7219-4ed4-ae8f-a7eb1fc214c9 tempest-VolumesDeleteCascade-663171339 None] Created volume successfully. Jul 27 13:16:02 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da 1073741824" returned: 0 in 0.457s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:03 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da Jul 27 13:16:03 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-111453bc-6196-49dd-9b7d-b7aeee902a2d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:03 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da" returned: 0 in 0.270s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3666fb4f-2de3-4687-b709-d5914f6d0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b3bac7-1e76-4729-a542-3ba05ad50e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-111453bc-6196-49dd-9b7d-b7aeee902a2d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Volume volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da (a8f6a758-601d-4c29-a3d3-8ee6a416d2da): created successfully Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b3bac7-1e76-4729-a542-3ba05ad50e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Flow 'volume_create_manager' (986db896-f471-4dd1-a8a6-3f4b9d9cd914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Performing cascade delete. {{(pid=88202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 27 13:16:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-09b18ff4-a735-4d62-a8bc-a1bcaffd6c64 tempest-VolumesTestJSON-1183675950 None] Created volume successfully. Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-b631e981-53d9-40fe-89da-bcfb77bdcf7b-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-b631e981-53d9-40fe-89da-bcfb77bdcf7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-111453bc-6196-49dd-9b7d-b7aeee902a2d" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-111453bc-6196-49dd-9b7d-b7aeee902a2d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-b631e981-53d9-40fe-89da-bcfb77bdcf7b" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-b631e981-53d9-40fe-89da-bcfb77bdcf7b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Deleting offline snapshot b631e981-53d9-40fe-89da-bcfb77bdcf7b of volume 111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] snapshot_file for this snap is: volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[040bae1b-d097-4b50-bff8-dce559c13332]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:03 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b Jul 27 13:16:03 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:03 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111453bc-6196-49dd-9b7d-b7aeee902a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27e7f2-3b5d-4c58-9728-cb82118f3a9c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:04 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:16:04 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:04 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Flow 'volume_create_manager' (7fb78fdc-15aa-4d21-8275-cc34f6742501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd049be7-85b1-4ee5-ad24-f84cf8296403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd049be7-85b1-4ee5-ad24-f84cf8296403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-763060532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebcaa17-524e-4bfd-b295-4aac4b6fcdff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e7a7780f6794869b765624a3056c1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:04Z,use_quota=True,user_id='a569c1d9b91248d5989fbbb42d67d20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:04 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b Jul 27 13:16:04 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26599db2-541d-49d7-994a-caafeae9f532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26599db2-541d-49d7-994a-caafeae9f532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbafd847-914f-4fcd-9404-d44f1ec9924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbafd847-914f-4fcd-9404-d44f1ec9924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebcaa17-524e-4bfd-b295-4aac4b6fcdff', 'volume_name': 'volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4661cf17-d4a2-4bf0-ba03-bc0650e23c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4661cf17-d4a2-4bf0-ba03-bc0650e23c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c977180-bd98-4d2d-8315-b66940a1b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Volume 5ebcaa17-524e-4bfd-b295-4aac4b6fcdff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff', 'volume_size': 1} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-763060532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebcaa17-524e-4bfd-b295-4aac4b6fcdff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e7a7780f6794869b765624a3056c1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:04Z,use_quota=True,user_id='a569c1d9b91248d5989fbbb42d67d20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Creating volume 5ebcaa17-524e-4bfd-b295-4aac4b6fcdff {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:04 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:04 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff 1073741824 Jul 27 13:16:04 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:04 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:04 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b Jul 27 13:16:04 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:04 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff 1073741824" returned: 0 in 0.523s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:05 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d.b631e981-53d9-40fe-89da-bcfb77bdcf7b" returned: 0 in 0.294s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:05 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff Jul 27 13:16:05 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-b631e981-53d9-40fe-89da-bcfb77bdcf7b" released by "_delete_snapshot" :: held 1.679s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-111453bc-6196-49dd-9b7d-b7aeee902a2d" released by "delete_snapshot" :: held 1.709s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Created reservations ['aa4866ea-64c2-4552-95e1-28f5f44d9794', '859f3aed-8995-478a-8fbd-f336f00f56af', 'c47a30c5-a2d9-4ff3-9a36-c0e57ad47717', '1905d61d-7fba-403c-9320-a2fb87041aab'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Delete snapshot completed successfully. Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-b631e981-53d9-40fe-89da-bcfb77bdcf7b-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Snapshots deleted, issuing volume delete {{(pid=88202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-111453bc-6196-49dd-9b7d-b7aeee902a2d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:05 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-111453bc-6196-49dd-9b7d-b7aeee902a2d" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff" returned: 0 in 0.303s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c977180-bd98-4d2d-8315-b66940a1b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a55c1a-1fc2-40f7-a24b-49958bcba92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606541a-021d-499b-a3be-dffa07e75c97]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Volume volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff (5ebcaa17-524e-4bfd-b295-4aac4b6fcdff): created successfully Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a55c1a-1fc2-40f7-a24b-49958bcba92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Flow 'volume_create_manager' (7fb78fdc-15aa-4d21-8275-cc34f6742501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-58b4f16a-85e3-4d1e-95da-86f75a27d58b tempest-VolumesTestJSON-1183675950 None] Created volume successfully. Jul 27 13:16:05 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:16:05 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:05 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.424s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:05 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d Jul 27 13:16:05 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:06 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-111453bc-6196-49dd-9b7d-b7aeee902a2d" returned: 0 in 0.256s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-111453bc-6196-49dd-9b7d-b7aeee902a2d" released by "delete_volume" :: held 0.750s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Created reservations ['181ffbb6-9e24-4647-8925-64829900cb73', '70208ef6-9153-473b-9955-ec48a4a30e5d', '08b7c240-dc65-4601-94b3-e239e40c52aa', 'b6a70fc5-56d5-43bc-84dd-6f71ec92bbca'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:06 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:06 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:06 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.272s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Deleted volume successfully. Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e2b3be48-b6e8-428c-88d7-149694acd121 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-111453bc-6196-49dd-9b7d-b7aeee902a2d-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-fe509703-3148-4240-a3f4-cf062875ce40-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-fe509703-3148-4240-a3f4-cf062875ce40-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "cinder-quobyte-fe509703-3148-4240-a3f4-cf062875ce40" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-fe509703-3148-4240-a3f4-cf062875ce40" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3abcd5-4fcb-4df3-adf5-677c3fd5214d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:07 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 Jul 27 13:16:07 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Flow 'volume_create_manager' (44337f91-a72c-422a-9ceb-eb8ff126e423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8336776-f92b-4fd6-b028-d00966430915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8336776-f92b-4fd6-b028-d00966430915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1536775458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3919f77d-7624-4aeb-a169-b1a67fff3a03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e7a7780f6794869b765624a3056c1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:07Z,use_quota=True,user_id='a569c1d9b91248d5989fbbb42d67d20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da56365c-8a9b-4054-bc93-5fd8687c7e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da56365c-8a9b-4054-bc93-5fd8687c7e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8de5185-5902-4c1a-88a6-03ff0b595523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8de5185-5902-4c1a-88a6-03ff0b595523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3919f77d-7624-4aeb-a169-b1a67fff3a03', 'volume_name': 'volume-3919f77d-7624-4aeb-a169-b1a67fff3a03', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b4371e-8064-4527-9927-b1424854f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b4371e-8064-4527-9927-b1424854f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fc4a2a-deb0-44bd-87db-26c81ef174b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:07 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Volume 3919f77d-7624-4aeb-a169-b1a67fff3a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3919f77d-7624-4aeb-a169-b1a67fff3a03', 'volume_size': 1} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1536775458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3919f77d-7624-4aeb-a169-b1a67fff3a03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e7a7780f6794869b765624a3056c1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:07Z,use_quota=True,user_id='a569c1d9b91248d5989fbbb42d67d20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Creating volume 3919f77d-7624-4aeb-a169-b1a67fff3a03 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:07 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:07 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40" returned: 0 in 0.475s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:07 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 1073741824 Jul 27 13:16:07 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:07 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40 Jul 27 13:16:07 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:07 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fe509703-3148-4240-a3f4-cf062875ce40" returned: 0 in 0.327s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-quobyte-fe509703-3148-4240-a3f4-cf062875ce40" released by "delete_volume" :: held 0.859s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Created reservations ['cfa1fb49-1998-404c-b8b1-d4047c9d8976', '7724b94a-1898-472c-809d-9f3b3ea3189f', '51706da9-d996-45bb-8752-51ff1448bec4', '98c803e9-8ab9-47f1-8a54-d06ab921063e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:07 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:07 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:08 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 1073741824" returned: 0 in 0.815s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:08 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 Jul 27 13:16:08 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:08 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.537s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Deleted volume successfully. Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4bbb8dfe-765e-4327-a6a0-3f34a1cdf917 tempest-VolumesDeleteCascade-663171339 None] Lock "cinder-fe509703-3148-4240-a3f4-cf062875ce40-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:08 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03" returned: 0 in 0.413s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fc4a2a-deb0-44bd-87db-26c81ef174b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3919f77d-7624-4aeb-a169-b1a67fff3a03', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067569c4-b687-4743-9433-7a7d83db035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Volume volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 (3919f77d-7624-4aeb-a169-b1a67fff3a03): created successfully Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067569c4-b687-4743-9433-7a7d83db035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Flow 'volume_create_manager' (44337f91-a72c-422a-9ceb-eb8ff126e423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-32d21804-e83b-419a-950b-3ef550c1d745 tempest-VolumesTestJSON-1183675950 None] Created volume successfully. Jul 27 13:16:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "cinder-3919f77d-7624-4aeb-a169-b1a67fff3a03-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-3919f77d-7624-4aeb-a169-b1a67fff3a03-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "cinder-quobyte-3919f77d-7624-4aeb-a169-b1a67fff3a03" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-quobyte-3919f77d-7624-4aeb-a169-b1a67fff3a03" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea33c4b-da38-49d6-9e4e-9f80a1c3922c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:10 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 Jul 27 13:16:10 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:11 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03" returned: 0 in 0.518s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:11 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03 Jul 27 13:16:11 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:11 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3919f77d-7624-4aeb-a169-b1a67fff3a03" returned: 0 in 0.420s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-quobyte-3919f77d-7624-4aeb-a169-b1a67fff3a03" released by "delete_volume" :: held 1.013s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:11 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Created reservations ['7166208e-88ac-48c2-94c8-256aa57d1d17', '21095f2c-fa94-4ebd-a73a-af8993648d4e', '45718ab3-cffb-4099-837d-3a92c072c37d', '183741cd-bf5c-4770-8fb6-898e69a0bcad'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:12 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:12 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:12 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.323s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Deleted volume successfully. Jul 27 13:16:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-24ab09ce-4d47-410b-984d-b51348f5e3b2 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-3919f77d-7624-4aeb-a169-b1a67fff3a03-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "cinder-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "cinder-quobyte-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-quobyte-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff" acquired by "delete_volume" :: waited 0.044s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af5472f-a6f3-4e39-8f91-d6a67f3a4526]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:13 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff Jul 27 13:16:13 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:13 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff" returned: 0 in 0.457s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:13 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff Jul 27 13:16:13 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:14 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff" returned: 0 in 0.309s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-quobyte-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff" released by "delete_volume" :: held 0.839s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Created reservations ['6edc01f1-cf65-4532-bf6b-f2daa6bb15d8', 'a66a7ff8-2608-4f73-89ff-861985342595', '29868d2f-845b-4687-9932-549c06a28827', '6b14c2ab-fa48-499f-be4e-54fcdc170d92'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:14 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:14 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "cinder-a8f6a758-601d-4c29-a3d3-8ee6a416d2da-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-a8f6a758-601d-4c29-a3d3-8ee6a416d2da-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "cinder-quobyte-a8f6a758-601d-4c29-a3d3-8ee6a416d2da" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-quobyte-a8f6a758-601d-4c29-a3d3-8ee6a416d2da" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d703cc2-7fbc-441b-ba9d-ef928d4ee7dc]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:14 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da Jul 27 13:16:14 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:14 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.473s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Deleted volume successfully. Jul 27 13:16:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c9bb2d6b-d2b2-414c-95f2-527424211b21 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-5ebcaa17-524e-4bfd-b295-4aac4b6fcdff-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Flow 'volume_create_manager' (2d546d10-a6ad-41b5-94e9-aaee138ae711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff41c28b-2387-4239-a19e-1da856517b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff41c28b-2387-4239-a19e-1da856517b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2065619459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f55bb9-d996-4a32-bdb4-efd66e527753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac589f77b5846b89beedddcc760f965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:15Z,use_quota=True,user_id='c34f55740c1344b0b590d7c7cd07522e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672fe4db-b997-44ef-99a2-a69555027d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672fe4db-b997-44ef-99a2-a69555027d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f548b4c-52a6-4df8-a77a-74df448c20e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f548b4c-52a6-4df8-a77a-74df448c20e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f55bb9-d996-4a32-bdb4-efd66e527753', 'volume_name': 'volume-c3f55bb9-d996-4a32-bdb4-efd66e527753', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9ee95c-13a7-4820-83dc-d77162e3904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9ee95c-13a7-4820-83dc-d77162e3904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd380af6-acf2-48f7-91c5-7352c1fbb33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:15 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Volume c3f55bb9-d996-4a32-bdb4-efd66e527753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f55bb9-d996-4a32-bdb4-efd66e527753', 'volume_size': 1} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2065619459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f55bb9-d996-4a32-bdb4-efd66e527753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac589f77b5846b89beedddcc760f965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:15Z,use_quota=True,user_id='c34f55740c1344b0b590d7c7cd07522e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Creating volume c3f55bb9-d996-4a32-bdb4-efd66e527753 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:15 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:15 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 1073741824 Jul 27 13:16:15 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:15 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da" returned: 0 in 0.639s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:15 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da Jul 27 13:16:15 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:15 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8f6a758-601d-4c29-a3d3-8ee6a416d2da" returned: 0 in 0.393s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-quobyte-a8f6a758-601d-4c29-a3d3-8ee6a416d2da" released by "delete_volume" :: held 1.131s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Created reservations ['9567860f-4a6c-4d73-925c-9d1eda0242c9', 'd36c954c-58b6-4cdc-9c57-a2c7bcfb52bd', '52c0a1bb-b3c3-4a2b-a0a3-8a65ca8efe48', 'a9cc5814-2589-40a3-b490-d4f86cee7714'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:15 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:15 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:15 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 1073741824" returned: 0 in 0.815s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:16 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 Jul 27 13:16:16 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:16 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.502s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Deleted volume successfully. Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d67c747c-4d4d-436c-b4c7-af96acf1f154 tempest-VolumesTestJSON-1183675950 None] Lock "cinder-a8f6a758-601d-4c29-a3d3-8ee6a416d2da-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:16 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753" returned: 0 in 0.400s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd380af6-acf2-48f7-91c5-7352c1fbb33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f55bb9-d996-4a32-bdb4-efd66e527753', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88b6dca-4177-418e-810b-3897471043a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:16 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Volume volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 (c3f55bb9-d996-4a32-bdb4-efd66e527753): created successfully Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88b6dca-4177-418e-810b-3897471043a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Flow 'volume_create_manager' (2d546d10-a6ad-41b5-94e9-aaee138ae711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-82e974c4-f3d8-44f8-9aa0-aaaefc25a4a2 tempest-VolumesTransfersV355Test-1044513179 None] Created volume successfully. Jul 27 13:16:18 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-abbf9fcb-c5d3-4ff6-8938-5525fbee602d tempest-VolumesTransfersV355Test-882240450 None] Transfer volume completed successfully. Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Acquiring lock "cinder-c3f55bb9-d996-4a32-bdb4-efd66e527753-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-c3f55bb9-d996-4a32-bdb4-efd66e527753-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Acquiring lock "cinder-quobyte-c3f55bb9-d996-4a32-bdb4-efd66e527753" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-quobyte-c3f55bb9-d996-4a32-bdb4-efd66e527753" acquired by "delete_volume" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[019097f9-b84b-4329-aad6-18f12d1a6d93]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Acquiring lock "cinder-976d3399-187c-4ca0-8f36-2aa81019cbf2-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "cinder-976d3399-187c-4ca0-8f36-2aa81019cbf2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:19 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 Jul 27 13:16:19 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Acquiring lock "cinder-quobyte-976d3399-187c-4ca0-8f36-2aa81019cbf2" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "cinder-quobyte-976d3399-187c-4ca0-8f36-2aa81019cbf2" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e0b23-3573-467b-b45b-e3c7e17181b5]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:19 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 Jul 27 13:16:19 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:19 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753" returned: 0 in 0.495s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:19 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753 Jul 27 13:16:19 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:19 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2" returned: 0 in 0.458s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:19 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2 Jul 27 13:16:19 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:19 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c3f55bb9-d996-4a32-bdb4-efd66e527753" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-quobyte-c3f55bb9-d996-4a32-bdb4-efd66e527753" released by "delete_volume" :: held 0.824s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Created reservations ['db77532a-8d4c-4671-9d0e-4dd1ae945092', '1b56fb35-e6b8-4b4a-82d9-3e70ce868def', 'fdaa7b27-4ace-4b7e-9399-534a9a134202', '922c5d2e-a64d-4dae-b12f-aa39c22347b5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:19 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-976d3399-187c-4ca0-8f36-2aa81019cbf2" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:19 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:19 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "cinder-quobyte-976d3399-187c-4ca0-8f36-2aa81019cbf2" released by "delete_volume" :: held 0.842s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Created reservations ['f7747c79-5ba4-4a04-950b-96309f1591a6', '27cbed0c-5a24-4429-8f4c-0425f84a6eb3', '5115b3b7-a853-4949-b4c8-786b7d934c3a', '71d741d7-7fcc-445d-bc46-9392c80f1c62'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:20 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.318s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:20 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Deleted volume successfully. Jul 27 13:16:20 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:20 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-601c4c03-16fe-4143-85bd-707bacb25c58 tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-c3f55bb9-d996-4a32-bdb4-efd66e527753-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:20 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.467s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:20 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Deleted volume successfully. Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e9739ac8-7e15-45e4-ab6b-12b8b383aae9 tempest-AttachVolumeShelveTestJSON-1727001988 None] Lock "cinder-976d3399-187c-4ca0-8f36-2aa81019cbf2-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Flow 'volume_create_manager' (af8ca2d9-364d-4b37-8b9b-045ea832b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1d271-1692-4a87-85aa-a0af9fe3d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1d271-1692-4a87-85aa-a0af9fe3d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-87219255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b88f19-fb97-4325-b3a9-00aa3e332b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac589f77b5846b89beedddcc760f965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:21Z,use_quota=True,user_id='c34f55740c1344b0b590d7c7cd07522e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df46cdb5-d838-424c-8016-b7e5c5942098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df46cdb5-d838-424c-8016-b7e5c5942098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174e7e44-c3f7-4975-9e0c-4a40843ff325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174e7e44-c3f7-4975-9e0c-4a40843ff325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b88f19-fb97-4325-b3a9-00aa3e332b46', 'volume_name': 'volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ade8afe-9cee-4f2e-8127-3b952fc0f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ade8afe-9cee-4f2e-8127-3b952fc0f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0566c7-607a-4c6b-80cf-65635ceecd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:20 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Volume a6b88f19-fb97-4325-b3a9-00aa3e332b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46', 'volume_size': 1} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-87219255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b88f19-fb97-4325-b3a9-00aa3e332b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac589f77b5846b89beedddcc760f965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:21Z,use_quota=True,user_id='c34f55740c1344b0b590d7c7cd07522e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Creating volume a6b88f19-fb97-4325-b3a9-00aa3e332b46 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:20 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:21 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 1073741824 Jul 27 13:16:21 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:21 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 1073741824" returned: 0 in 0.666s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:21 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 Jul 27 13:16:21 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:22 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46" returned: 0 in 0.366s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0566c7-607a-4c6b-80cf-65635ceecd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4ee482-2a0f-4715-b364-91b52fe731fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:22 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Volume volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 (a6b88f19-fb97-4325-b3a9-00aa3e332b46): created successfully Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4ee482-2a0f-4715-b364-91b52fe731fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Flow 'volume_create_manager' (af8ca2d9-364d-4b37-8b9b-045ea832b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f4a142ef-944e-4fc1-8c71-85375517566c tempest-VolumesTransfersV355Test-1044513179 None] Created volume successfully. Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Acquiring lock "cinder-a6b88f19-fb97-4325-b3a9-00aa3e332b46-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-a6b88f19-fb97-4325-b3a9-00aa3e332b46-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Acquiring lock "cinder-quobyte-a6b88f19-fb97-4325-b3a9-00aa3e332b46" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-quobyte-a6b88f19-fb97-4325-b3a9-00aa3e332b46" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c648c245-f0db-443a-9602-51513687599c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:23 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 Jul 27 13:16:23 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:23 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46" returned: 0 in 0.485s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:24 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46 Jul 27 13:16:24 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:24 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a6b88f19-fb97-4325-b3a9-00aa3e332b46" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-quobyte-a6b88f19-fb97-4325-b3a9-00aa3e332b46" released by "delete_volume" :: held 0.986s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Created reservations ['118f2f58-bff2-4c0c-ae30-883e443b3c5f', '592b86a0-7f67-402a-a285-fde6e72b7d6a', 'ae01094b-2ba3-4570-92d7-517c0acf82ef', '60eeb539-8eab-4dba-a3f0-a5088907b6db'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:24 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:24 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:24 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.306s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:24 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Deleted volume successfully. Jul 27 13:16:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b4fb611-a085-4eb5-bd33-fc322caf830b tempest-VolumesTransfersV355Test-1346569189 None] Lock "cinder-a6b88f19-fb97-4325-b3a9-00aa3e332b46-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:33 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:33 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:33 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.449s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 8 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:16:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:16:34 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=67,cinder:INSERT=18,cinder:UPDATE=91,cinder:DELETE=7 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:16:34 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=89,cinder:SELECT=59,cinder:INSERT=25,cinder:DELETE=9 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Flow 'volume_create_manager' (2845e72f-7987-44f4-bfe6-0494019bd619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3d706b-2128-48f8-a3df-9ce26f65a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3d706b-2128-48f8-a3df-9ce26f65a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-107772972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6c1609-7356-4da7-85d0-043649375fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82aae454a7e64da881d5c9130a1aaa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:35Z,use_quota=True,user_id='08ba089ed750433fbecf3ae75bc6b25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319abbb3-07a9-467d-beca-b2cb1970c69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319abbb3-07a9-467d-beca-b2cb1970c69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93455ad6-3baf-42bb-8846-dd21905abe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93455ad6-3baf-42bb-8846-dd21905abe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6c1609-7356-4da7-85d0-043649375fdf', 'volume_name': 'volume-0e6c1609-7356-4da7-85d0-043649375fdf', 'volume_size': 2}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faca2f6-6b1d-42f1-bb7d-b81304c4b710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faca2f6-6b1d-42f1-bb7d-b81304c4b710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f26f820-0794-4170-b73d-c6cfc77e692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:35 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Volume 0e6c1609-7356-4da7-85d0-043649375fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6c1609-7356-4da7-85d0-043649375fdf', 'volume_size': 2} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-107772972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6c1609-7356-4da7-85d0-043649375fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82aae454a7e64da881d5c9130a1aaa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:35Z,use_quota=True,user_id='08ba089ed750433fbecf3ae75bc6b25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Creating volume 0e6c1609-7356-4da7-85d0-043649375fdf {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:35 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf 2147483648 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:35 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf 2147483648 Jul 27 13:16:35 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:36 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf 2147483648" returned: 0 in 0.609s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:36 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf Jul 27 13:16:36 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:36 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf" returned: 0 in 0.423s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f26f820-0794-4170-b73d-c6cfc77e692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6c1609-7356-4da7-85d0-043649375fdf', 'volume_size': 2}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1564ca0-7ae1-4e51-ad4b-0ade96c401d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:36 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Volume volume-0e6c1609-7356-4da7-85d0-043649375fdf (0e6c1609-7356-4da7-85d0-043649375fdf): created successfully Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1564ca0-7ae1-4e51-ad4b-0ade96c401d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Flow 'volume_create_manager' (2845e72f-7987-44f4-bfe6-0494019bd619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:36 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-adb53e18-f76e-4127-91d1-8472e174c2e7 tempest-VolumesCloneNegativeTest-1459717177 None] Created volume successfully. Jul 27 13:16:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Acquiring lock "cinder-0e6c1609-7356-4da7-85d0-043649375fdf-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "cinder-0e6c1609-7356-4da7-85d0-043649375fdf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Acquiring lock "cinder-quobyte-0e6c1609-7356-4da7-85d0-043649375fdf" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "cinder-quobyte-0e6c1609-7356-4da7-85d0-043649375fdf" acquired by "delete_volume" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de10bb6-f5d7-41a4-bc9a-a4ed0a37716b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:38 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf Jul 27 13:16:38 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:38 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf" returned: 0 in 0.646s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:38 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf Jul 27 13:16:38 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:39 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e6c1609-7356-4da7-85d0-043649375fdf" returned: 0 in 0.469s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "cinder-quobyte-0e6c1609-7356-4da7-85d0-043649375fdf" released by "delete_volume" :: held 1.196s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Created reservations ['e45f0d15-f616-4169-84fd-ffcc35f903d9', '415ea2cc-3a38-4e44-ab7c-e480653ecb26', 'bb895e79-5182-484f-9b5a-6a74a0e39d69', '7e51fe85-d91b-44d9-83c8-92a8695c8f90'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:39 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:39 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:39 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.318s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Deleted volume successfully. Jul 27 13:16:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5eb6021-22aa-472a-8a1f-f6e78dc08bd5 tempest-VolumesCloneNegativeTest-1459717177 None] Lock "cinder-0e6c1609-7356-4da7-85d0-043649375fdf-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c07732c1-4c5c-4301-8ad7-a81b9f61466e tempest-GroupsTest-289321122 None] Group tempest-Group1-747070394: creating Jul 27 13:16:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c07732c1-4c5c-4301-8ad7-a81b9f61466e tempest-GroupsTest-289321122 None] Group tempest-Group1-747070394: created successfully Jul 27 13:16:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c07732c1-4c5c-4301-8ad7-a81b9f61466e tempest-GroupsTest-289321122 None] Create group completed successfully. Jul 27 13:16:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-007af34f-855d-4a62-b4c9-9927be9c3215 tempest-GroupsTest-289321122 None] Group tempest-Group2-1456599016: creating Jul 27 13:16:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-007af34f-855d-4a62-b4c9-9927be9c3215 tempest-GroupsTest-289321122 None] Group tempest-Group2-1456599016: created successfully Jul 27 13:16:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-007af34f-855d-4a62-b4c9-9927be9c3215 tempest-GroupsTest-289321122 None] Create group completed successfully. Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Flow 'volume_create_manager' (4a955b29-687c-48e6-8c10-b2c39c9e96e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5998ce3e-4151-4178-81ea-14931fcd20ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5998ce3e-4151-4178-81ea-14931fcd20ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-163511117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7603fe45-21db-4e27-9aac-38153c65861e,host='devstack@QuobyteHD#QuobyteHD',id=34a59b3b-4ff6-404a-8497-c3c6d5026b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6874ccd1384ff09f1cfa0b2e359546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:44Z,use_quota=True,user_id='018ad4cd2724471dbca8cc2d781cbb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fcbd2de-0574-4c40-abbf-a0026f219061),volume_type_id=0fcbd2de-0574-4c40-abbf-a0026f219061)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455a3ff2-0750-4b0b-837e-bbe073d22957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455a3ff2-0750-4b0b-837e-bbe073d22957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0bec79-8f94-43c3-ae40-ef6b776d1ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0bec79-8f94-43c3-ae40-ef6b776d1ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a59b3b-4ff6-404a-8497-c3c6d5026b46', 'volume_name': 'volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c365d5-73f0-47e9-81bf-670c3c8522e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c365d5-73f0-47e9-81bf-670c3c8522e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670328b1-56c8-4b2e-a427-e47c359ab06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:44 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Volume 34a59b3b-4ff6-404a-8497-c3c6d5026b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46', 'volume_size': 1} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7603fe45-21db-4e27-9aac-38153c65861e,created_at=2026-07-27T11:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-163511117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7603fe45-21db-4e27-9aac-38153c65861e,host='devstack@QuobyteHD#QuobyteHD',id=34a59b3b-4ff6-404a-8497-c3c6d5026b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6874ccd1384ff09f1cfa0b2e359546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:44Z,use_quota=True,user_id='018ad4cd2724471dbca8cc2d781cbb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fcbd2de-0574-4c40-abbf-a0026f219061),volume_type_id=0fcbd2de-0574-4c40-abbf-a0026f219061)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Creating volume 34a59b3b-4ff6-404a-8497-c3c6d5026b46 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:44 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:44 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 1073741824 Jul 27 13:16:44 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:44 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 1073741824" returned: 0 in 0.567s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:44 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 Jul 27 13:16:44 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:45 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670328b1-56c8-4b2e-a427-e47c359ab06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b0ef0a-bf48-4e20-bf7b-dbffbf7cdb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:45 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Volume volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 (34a59b3b-4ff6-404a-8497-c3c6d5026b46): created successfully Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b0ef0a-bf48-4e20-bf7b-dbffbf7cdb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Flow 'volume_create_manager' (4a955b29-687c-48e6-8c10-b2c39c9e96e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-be22380b-add1-4a98-aa0d-6073ec9b938f tempest-GroupsTest-289321122 None] Created volume successfully. Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Acquiring lock "cinder-quobyte-34a59b3b-4ff6-404a-8497-c3c6d5026b46" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Lock "cinder-quobyte-34a59b3b-4ff6-404a-8497-c3c6d5026b46" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a05a0ce-8033-403e-9c57-21e98efeeb54]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:46 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 Jul 27 13:16:46 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:46 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:46 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46 Jul 27 13:16:46 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:46 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34a59b3b-4ff6-404a-8497-c3c6d5026b46" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Lock "cinder-quobyte-34a59b3b-4ff6-404a-8497-c3c6d5026b46" released by "delete_volume" :: held 0.759s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Created reservations ['d0bb9928-361f-4f8a-977a-3b5aac44cfc5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:46 devstack cinder-volume[88202]: WARNING cinder.quota [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1558772676 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1558772676, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:16:46 devstack cinder-volume[88202]: WARNING cinder.quota [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1558772676 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1558772676, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:16:46 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Created reservations ['93c22000-f068-40a4-98b1-b2d57b85f4d1', '322c0e57-5f6a-4fde-bb2e-9765b9c9d649', 'e000e536-dfbe-49bc-a53b-7e94e4031bcc', '40f56d20-0269-46ae-a007-5a98c384e22f'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:47 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:47 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:47 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.349s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3c06b9c3-6120-4684-aa57-19cb52d97d88 tempest-GroupsTest-289321122 None] Delete group completed successfully. Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Created reservations ['6346ce90-ea2e-42b2-9466-b23b7f6ba587'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:47 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:16:47 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:47 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.277s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:47 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:16:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c6036650-d49b-4b06-b19d-812285f8d97e tempest-GroupsTest-289321122 None] Delete group completed successfully. Jul 27 13:16:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6387b2b1-1aff-487d-abc7-475e3766eb6a tempest-GroupsTest-289321122 None] Group tempest-GroupsTest-Group-410808515: creating Jul 27 13:16:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6387b2b1-1aff-487d-abc7-475e3766eb6a tempest-GroupsTest-289321122 None] Group tempest-GroupsTest-Group-410808515: created successfully Jul 27 13:16:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6387b2b1-1aff-487d-abc7-475e3766eb6a tempest-GroupsTest-289321122 None] Create group completed successfully. Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Flow 'volume_create_manager' (644c3653-aae4-4250-a60d-546f0eb90d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976b419c-76ce-4ef2-bfa0-eaff8a6b5712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976b419c-76ce-4ef2-bfa0-eaff8a6b5712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727163627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bba2b0c2-abde-430f-9a05-f9691fa475bd,host='devstack@QuobyteHD#QuobyteHD',id=75b53624-efcb-43f1-8873-e8ac84059711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6874ccd1384ff09f1cfa0b2e359546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:51Z,use_quota=True,user_id='018ad4cd2724471dbca8cc2d781cbb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b67e3b8-e81e-4297-8b9c-70a25625125f),volume_type_id=9b67e3b8-e81e-4297-8b9c-70a25625125f)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a146d6-0b40-4771-b851-a770454ca5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a146d6-0b40-4771-b851-a770454ca5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ca4014-fd8a-491c-b9f1-67ef7c9cd000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ca4014-fd8a-491c-b9f1-67ef7c9cd000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b53624-efcb-43f1-8873-e8ac84059711', 'volume_name': 'volume-75b53624-efcb-43f1-8873-e8ac84059711', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e768263b-73bb-45b4-8351-8d2ffafcebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e768263b-73bb-45b4-8351-8d2ffafcebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85e258e-8da8-4b62-8d46-d73f2e845548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Volume 75b53624-efcb-43f1-8873-e8ac84059711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b53624-efcb-43f1-8873-e8ac84059711', 'volume_size': 1} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bba2b0c2-abde-430f-9a05-f9691fa475bd,created_at=2026-07-27T11:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727163627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bba2b0c2-abde-430f-9a05-f9691fa475bd,host='devstack@QuobyteHD#QuobyteHD',id=75b53624-efcb-43f1-8873-e8ac84059711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6874ccd1384ff09f1cfa0b2e359546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:51Z,use_quota=True,user_id='018ad4cd2724471dbca8cc2d781cbb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b67e3b8-e81e-4297-8b9c-70a25625125f),volume_type_id=9b67e3b8-e81e-4297-8b9c-70a25625125f)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Creating volume 75b53624-efcb-43f1-8873-e8ac84059711 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:51 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:51 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 1073741824 Jul 27 13:16:51 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:52 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 1073741824" returned: 0 in 0.739s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:52 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 Jul 27 13:16:52 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:52 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711" returned: 0 in 0.544s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85e258e-8da8-4b62-8d46-d73f2e845548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b53624-efcb-43f1-8873-e8ac84059711', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5944a9-8606-4522-81c0-b88bc953d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Volume volume-75b53624-efcb-43f1-8873-e8ac84059711 (75b53624-efcb-43f1-8873-e8ac84059711): created successfully Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5944a9-8606-4522-81c0-b88bc953d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Flow 'volume_create_manager' (644c3653-aae4-4250-a60d-546f0eb90d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-07e0f8ca-a07a-4475-94ce-f862e2b14f0b tempest-GroupsTest-289321122 None] Created volume successfully. Jul 27 13:16:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Flow 'volume_create_manager' (ef6e1fa2-961d-4baa-a7d6-387de6995526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadf63f9-e74a-473f-95ac-8653af8665e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadf63f9-e74a-473f-95ac-8653af8665e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223674197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bba2b0c2-abde-430f-9a05-f9691fa475bd,host='devstack@QuobyteHD#QuobyteHD',id=feaf7f73-4c04-4017-a256-881d5fef86eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6874ccd1384ff09f1cfa0b2e359546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:55Z,use_quota=True,user_id='018ad4cd2724471dbca8cc2d781cbb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b67e3b8-e81e-4297-8b9c-70a25625125f),volume_type_id=9b67e3b8-e81e-4297-8b9c-70a25625125f)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c0156f-1c12-4a27-acf0-c62ed284173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c0156f-1c12-4a27-acf0-c62ed284173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031f8d1c-d369-4216-a6ce-9d6c395aa0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031f8d1c-d369-4216-a6ce-9d6c395aa0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feaf7f73-4c04-4017-a256-881d5fef86eb', 'volume_name': 'volume-feaf7f73-4c04-4017-a256-881d5fef86eb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc1749b-9d08-47f3-b260-050f72761c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc1749b-9d08-47f3-b260-050f72761c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81884bcb-167c-4eaf-94c5-e1071dbb2c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Volume feaf7f73-4c04-4017-a256-881d5fef86eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feaf7f73-4c04-4017-a256-881d5fef86eb', 'volume_size': 1} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bba2b0c2-abde-430f-9a05-f9691fa475bd,created_at=2026-07-27T11:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223674197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bba2b0c2-abde-430f-9a05-f9691fa475bd,host='devstack@QuobyteHD#QuobyteHD',id=feaf7f73-4c04-4017-a256-881d5fef86eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6874ccd1384ff09f1cfa0b2e359546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:55Z,use_quota=True,user_id='018ad4cd2724471dbca8cc2d781cbb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b67e3b8-e81e-4297-8b9c-70a25625125f),volume_type_id=9b67e3b8-e81e-4297-8b9c-70a25625125f)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Creating volume feaf7f73-4c04-4017-a256-881d5fef86eb {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:55 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:55 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb 1073741824 Jul 27 13:16:55 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:55 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb 1073741824" returned: 0 in 0.780s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:56 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb Jul 27 13:16:56 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:56 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb" returned: 0 in 0.488s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81884bcb-167c-4eaf-94c5-e1071dbb2c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feaf7f73-4c04-4017-a256-881d5fef86eb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b4d008-ff96-4d77-8902-2aa3e04c0b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Volume volume-feaf7f73-4c04-4017-a256-881d5fef86eb (feaf7f73-4c04-4017-a256-881d5fef86eb): created successfully Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b4d008-ff96-4d77-8902-2aa3e04c0b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Flow 'volume_create_manager' (ef6e1fa2-961d-4baa-a7d6-387de6995526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8571cd43-e4a9-40c3-8017-509d416f1e55 tempest-GroupsTest-289321122 None] Created volume successfully. Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Flow 'volume_create_manager' (9517cf1e-a1f1-454a-b3dc-ae510d3489f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63806ab-a8bb-4205-82a5-03530edeae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63806ab-a8bb-4205-82a5-03530edeae58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1467383689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35adcf26-3bad-4153-8878-f39eae62587e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3485d65ed4c941a69aca8dbeb62c9411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:57Z,use_quota=True,user_id='7f9542b0ea384867a2380724703c6427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a01f3d-47dc-45b7-9809-4fd889ddce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a01f3d-47dc-45b7-9809-4fd889ddce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c326ef8-37f9-4630-93c4-204c75b9a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c326ef8-37f9-4630-93c4-204c75b9a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35adcf26-3bad-4153-8878-f39eae62587e', 'volume_name': 'volume-35adcf26-3bad-4153-8878-f39eae62587e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4183eeb-4c68-48dc-8226-3aa0e9d17eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4183eeb-4c68-48dc-8226-3aa0e9d17eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b152b8e1-e458-4ad8-a04e-33777f55768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Volume 35adcf26-3bad-4153-8878-f39eae62587e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35adcf26-3bad-4153-8878-f39eae62587e', 'volume_size': 1} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1467383689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35adcf26-3bad-4153-8878-f39eae62587e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3485d65ed4c941a69aca8dbeb62c9411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:57Z,use_quota=True,user_id='7f9542b0ea384867a2380724703c6427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Creating volume 35adcf26-3bad-4153-8878-f39eae62587e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:56 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e 1073741824 Jul 27 13:16:56 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:57 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e 1073741824" returned: 0 in 0.914s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:57 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e Jul 27 13:16:57 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5661ce68-3689-47ea-8c61-6e66a095ecba tempest-GroupsTest-289321122 None] Update group completed successfully. Jul 27 13:16:58 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b152b8e1-e458-4ad8-a04e-33777f55768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35adcf26-3bad-4153-8878-f39eae62587e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a61ef79-50ce-4e7b-b851-971d30b1cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:58 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Volume volume-35adcf26-3bad-4153-8878-f39eae62587e (35adcf26-3bad-4153-8878-f39eae62587e): created successfully Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a61ef79-50ce-4e7b-b851-971d30b1cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Flow 'volume_create_manager' (9517cf1e-a1f1-454a-b3dc-ae510d3489f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-39f6dc30-e046-4a6a-9e65-e5ccf38ae63b tempest-AttachVolumeTestJSON-570659394 None] Created volume successfully. Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (cd0a8952-252e-4557-92a0-a8c68738b76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a157cf3e-452c-4f7a-989c-d4dbcfa74b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a157cf3e-452c-4f7a-989c-d4dbcfa74b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1084875406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b919114c-e557-49ab-b71a-e8f81d08486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:59Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6ca51c-c699-4381-9bd0-5bb322795b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6ca51c-c699-4381-9bd0-5bb322795b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12033ff-c3d7-4b98-be39-98eb0ae2fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12033ff-c3d7-4b98-be39-98eb0ae2fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b919114c-e557-49ab-b71a-e8f81d08486c', 'volume_name': 'volume-b919114c-e557-49ab-b71a-e8f81d08486c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d18905-b7d0-4fbe-b0f4-828280a16c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d18905-b7d0-4fbe-b0f4-828280a16c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c02ad08-508f-45e6-a043-227f5f61c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:16:59 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Volume b919114c-e557-49ab-b71a-e8f81d08486c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b919114c-e557-49ab-b71a-e8f81d08486c', 'volume_size': 1} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1084875406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b919114c-e557-49ab-b71a-e8f81d08486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:16:59Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Creating volume b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:16:59 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:16:59 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c 1073741824 Jul 27 13:16:59 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:16:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-09abedf7-fdd8-4975-bf4c-28f6bbeebd12 tempest-GroupsTest-289321122 None] Update group completed successfully. Jul 27 13:16:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-fcdc57e0-74b8-4797-8cb3-78cd5b69b528 req-936f8166-d538-47b6-a956-676e18398a78 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:00 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c 1073741824" returned: 0 in 0.618s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:00 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c Jul 27 13:17:00 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:00 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c" returned: 0 in 0.262s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-fcdc57e0-74b8-4797-8cb3-78cd5b69b528 req-936f8166-d538-47b6-a956-676e18398a78 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.496s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c02ad08-508f-45e6-a043-227f5f61c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b919114c-e557-49ab-b71a-e8f81d08486c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222fa919-5189-42c9-be63-5b6763421689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-fcdc57e0-74b8-4797-8cb3-78cd5b69b528 req-936f8166-d538-47b6-a956-676e18398a78 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:00 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Volume volume-b919114c-e557-49ab-b71a-e8f81d08486c (b919114c-e557-49ab-b71a-e8f81d08486c): created successfully Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222fa919-5189-42c9-be63-5b6763421689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (cd0a8952-252e-4557-92a0-a8c68738b76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c1509b93-7753-4ce4-8f97-8b8a9287cdbb tempest-VolumesSnapshotTestJSON-1896173882 None] Created volume successfully. Jul 27 13:17:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-fcdc57e0-74b8-4797-8cb3-78cd5b69b528 req-936f8166-d538-47b6-a956-676e18398a78 tempest-AttachVolumeTestJSON-570659394 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-35adcf26-3bad-4153-8878-f39eae62587e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0575ffc4-5eb5-44b2-a70c-3e827c15a8f7', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:17:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-fcdc57e0-74b8-4797-8cb3-78cd5b69b528 req-936f8166-d538-47b6-a956-676e18398a78 tempest-AttachVolumeTestJSON-570659394 None] attachment_update completed successfully. Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Acquiring lock "cinder-quobyte-75b53624-efcb-43f1-8873-e8ac84059711" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Lock "cinder-quobyte-75b53624-efcb-43f1-8873-e8ac84059711" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[714c50b1-6ab6-49a2-872b-3a291474df74]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:01 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 Jul 27 13:17:01 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Creating offline snapshot dadec30c-7e0c-415a-b915-88f0bd690eb5 of volume b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ddbc8-6f3a-4077-ad9e-bb06102d07d0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:02 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c Jul 27 13:17:02 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:02 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711" returned: 0 in 0.565s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:02 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711 Jul 27 13:17:02 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:02 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c" returned: 0 in 0.590s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:02 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-75b53624-efcb-43f1-8873-e8ac84059711" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:02 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 1G Jul 27 13:17:02 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Lock "cinder-quobyte-75b53624-efcb-43f1-8873-e8ac84059711" released by "delete_volume" :: held 1.056s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Acquiring lock "cinder-quobyte-feaf7f73-4c04-4017-a256-881d5fef86eb" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Lock "cinder-quobyte-feaf7f73-4c04-4017-a256-881d5fef86eb" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ef0122-eb20-4d01-a293-ae08763cb641]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:02 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb Jul 27 13:17:02 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:03 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 1G" returned: 0 in 0.569s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b919114c-e557-49ab-b71a-e8f81d08486c -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:03 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b919114c-e557-49ab-b71a-e8f81d08486c -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 Jul 27 13:17:03 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:03 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb" returned: 0 in 0.531s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:03 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb Jul 27 13:17:03 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:03 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b919114c-e557-49ab-b71a-e8f81d08486c -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5" returned: 0 in 0.305s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:03 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 is being set with open permissions: ugo+rw Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:03 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 Jul 27 13:17:03 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:03 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-feaf7f73-4c04-4017-a256-881d5fef86eb" returned: 0 in 0.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Lock "cinder-quobyte-feaf7f73-4c04-4017-a256-881d5fef86eb" released by "delete_volume" :: held 0.887s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Created reservations ['bbe993af-15c0-4f62-a8f6-ebe470bf0312'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:03 devstack cinder-volume[88202]: WARNING cinder.quota [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-353567924 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-353567924, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:17:03 devstack cinder-volume[88202]: WARNING cinder.quota [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-353567924 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-353567924, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Created reservations ['53b06b82-4a3b-4d0b-bce1-d218622d31eb', 'f3a1e308-15e1-449f-80c3-ed0a702bad3a', '05be4207-62c4-44ad-b7a3-366957782cbd', 'da938942-8589-4891-a654-74b91bb3c956'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:03 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5" returned: 0 in 0.293s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:03 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info Jul 27 13:17:03 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Created reservations ['8c3a17e6-a2da-43ba-b529-efbdff862f2b', 'c5fbb408-42e7-4ba5-8869-520ec0234479', 'c8b44ca3-237d-4694-b4e0-991a3f38688f', '0b83e160-7d1e-40c5-865b-205afed8cc60'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:03 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:03 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:04 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info" returned: 0 in 0.391s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:04 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info is being set with open permissions: ugo+rw Jul 27 13:17:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:04 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info Jul 27 13:17:04 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:04 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.info" returned: 0 in 0.379s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:04 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.612s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:04 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d1092612-d169-4061-b68f-a5cc4fbb369a tempest-GroupsTest-289321122 None] Delete group completed successfully. Jul 27 13:17:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-170fcec2-32ec-4d42-9ff2-d614701d94bb tempest-VolumesSnapshotTestJSON-1896173882 None] Create snapshot completed successfully Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-dadec30c-7e0c-415a-b915-88f0bd690eb5-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-dadec30c-7e0c-415a-b915-88f0bd690eb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-b919114c-e557-49ab-b71a-e8f81d08486c" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-b919114c-e557-49ab-b71a-e8f81d08486c" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-dadec30c-7e0c-415a-b915-88f0bd690eb5" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-dadec30c-7e0c-415a-b915-88f0bd690eb5" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleting offline snapshot dadec30c-7e0c-415a-b915-88f0bd690eb5 of volume b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] snapshot_file for this snap is: volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc90a2d4-6901-4b44-9b04-6629eeaca8e0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:05 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 Jul 27 13:17:05 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:06 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5" returned: 0 in 0.628s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b919114c-e557-49ab-b71a-e8f81d08486c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:17:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6088ef-2932-4fb1-87a5-90fa1ff5a898]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:06 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c Jul 27 13:17:06 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:07 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c" returned: 0 in 0.634s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:07 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 Jul 27 13:17:07 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:07 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5" returned: 0 in 0.792s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:07 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5 Jul 27 13:17:07 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c.dadec30c-7e0c-415a-b915-88f0bd690eb5" returned: 0 in 0.624s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:08 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-dadec30c-7e0c-415a-b915-88f0bd690eb5" released by "_delete_snapshot" :: held 2.930s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-b919114c-e557-49ab-b71a-e8f81d08486c" released by "delete_snapshot" :: held 2.999s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['a60a7800-0767-4d30-8813-2bbb14cbf5d7', '441608e2-c2a4-4724-a4a3-6c7e4a8c7968', '9190fb28-0a03-4cf3-8a82-682b0e344a95', '44790b06-b7ed-4b88-84fa-f65243cbfd8c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Delete snapshot completed successfully. Jul 27 13:17:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a8022747-8d95-480d-9b1e-46ead7c53f35 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-dadec30c-7e0c-415a-b915-88f0bd690eb5-delete_snapshot" released by "delete_snapshot" :: held 3.418s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (69c35066-a6b8-46f4-a330-5d91ee482fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffebe3d9-dea2-400e-aba2-1d1e10895cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffebe3d9-dea2-400e-aba2-1d1e10895cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-461036926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ffc672-6c5b-495d-8687-b60ae41c4f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:10Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9003c9d-896c-48fc-8fe5-878786d4f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9003c9d-896c-48fc-8fe5-878786d4f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18f9a5a-c684-4617-a7bf-79a131a7c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18f9a5a-c684-4617-a7bf-79a131a7c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ffc672-6c5b-495d-8687-b60ae41c4f46', 'volume_name': 'volume-36ffc672-6c5b-495d-8687-b60ae41c4f46', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9f87bd-dac4-4329-bc3c-6ffc393dc547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9f87bd-dac4-4329-bc3c-6ffc393dc547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d426a08c-f105-4523-a3be-a3c422d78f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Volume 36ffc672-6c5b-495d-8687-b60ae41c4f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ffc672-6c5b-495d-8687-b60ae41c4f46', 'volume_size': 1} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-461036926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ffc672-6c5b-495d-8687-b60ae41c4f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:10Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Creating volume 36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:17:10 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:17:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:10 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 1073741824 Jul 27 13:17:10 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:11 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 1073741824" returned: 0 in 0.598s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:11 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:11 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:11 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.281s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d426a08c-f105-4523-a3be-a3c422d78f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ffc672-6c5b-495d-8687-b60ae41c4f46', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b755106-f34f-4633-b8a9-104c3f73f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:11 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Volume volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 (36ffc672-6c5b-495d-8687-b60ae41c4f46): created successfully Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b755106-f34f-4633-b8a9-104c3f73f037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (69c35066-a6b8-46f4-a330-5d91ee482fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1608e7ca-e361-40d5-a3dc-53b6f19c0c11 tempest-VolumesSnapshotTestJSON-1896173882 None] Created volume successfully. Jul 27 13:17:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Creating offline snapshot d09c077b-e7d1-4b79-accf-c6d00e3b89aa of volume 36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:17:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dda7b4-4280-45b4-8f88-bd21d60a0352]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:12 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:12 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:13 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.411s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:13 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa 1G Jul 27 13:17:13 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:13 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa 1G" returned: 0 in 0.510s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:13 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa Jul 27 13:17:13 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:14 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa" returned: 0 in 0.464s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:14 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa is being set with open permissions: ugo+rw Jul 27 13:17:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:14 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa Jul 27 13:17:14 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:14 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa" returned: 0 in 0.442s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:14 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info Jul 27 13:17:14 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:15 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info" returned: 0 in 0.564s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:15 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info is being set with open permissions: ugo+rw Jul 27 13:17:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:15 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info Jul 27 13:17:15 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:15 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.info" returned: 0 in 0.367s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-846b3969-8a18-48e7-a475-c0046f6a6a2d tempest-VolumesSnapshotTestJSON-1896173882 None] Create snapshot completed successfully Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (038de32f-b8f7-486a-ad9c-739da5a6d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98557611-6705-4ff8-9f79-a7471a8146e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98557611-6705-4ff8-9f79-a7471a8146e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-113192129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d5b192-76fc-4f4c-a57c-993ed238edf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d09c077b-e7d1-4b79-accf-c6d00e3b89aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:16Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2516a7-0491-4b47-9404-502ea810d051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2516a7-0491-4b47-9404-502ea810d051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da708743-750f-4759-8409-7602fb51a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da708743-750f-4759-8409-7602fb51a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6d5b192-76fc-4f4c-a57c-993ed238edf0', 'volume_name': 'volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0', 'volume_size': 2, 'snapshot_id': 'd09c077b-e7d1-4b79-accf-c6d00e3b89aa'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6b2706-41c3-43ba-b6be-0927d30ac0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6b2706-41c3-43ba-b6be-0927d30ac0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f6e706-1e03-4720-b6f5-7f8ab0fdbce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:16 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Volume e6d5b192-76fc-4f4c-a57c-993ed238edf0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0', 'volume_size': 2, 'snapshot_id': 'd09c077b-e7d1-4b79-accf-c6d00e3b89aa'} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-d09c077b-e7d1-4b79-accf-c6d00e3b89aa-e6d5b192-76fc-4f4c-a57c-993ed238edf0" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-d09c077b-e7d1-4b79-accf-c6d00e3b89aa-e6d5b192-76fc-4f4c-a57c-993ed238edf0" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Creating volume e6d5b192-76fc-4f4c-a57c-993ed238edf0 from snapshot d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-e6d5b192-76fc-4f4c-a57c-993ed238edf0" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-e6d5b192-76fc-4f4c-a57c-993ed238edf0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] snapshot: d09c077b-e7d1-4b79-accf-c6d00e3b89aa, volume: e6d5b192-76fc-4f4c-a57c-993ed238edf0, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c9a2f-49e8-42b9-8242-d55780b69cda]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:16 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa Jul 27 13:17:16 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:17 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa" returned: 0 in 0.384s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ffc672-6c5b-495d-8687-b60ae41c4f46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[522bfeae-188b-4c0e-ac37-eb2ce0f5fd78]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:17 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:17 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:17 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.498s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:17:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:17 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 Jul 27 13:17:17 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Flow 'volume_create_manager' (fcc270a2-6606-4a80-ae5f-71f3d7d9b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51a659d-07c6-4683-93b3-2869afc06095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51a659d-07c6-4683-93b3-2869afc06095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2123723384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52b40f5-0f69-4117-ac18-3393e60737c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270595c216764c6aabd454783948237c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:20Z,use_quota=True,user_id='2d464e3c1ee04a7ab75cb7fcb7993bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51b580d-0e9a-482d-b695-4350b4784ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51b580d-0e9a-482d-b695-4350b4784ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3f82ff-f643-4890-aeee-5c5e428bf047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3f82ff-f643-4890-aeee-5c5e428bf047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52b40f5-0f69-4117-ac18-3393e60737c4', 'volume_name': 'volume-c52b40f5-0f69-4117-ac18-3393e60737c4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11ee8da-a26f-4353-b114-96b9e0f29e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11ee8da-a26f-4353-b114-96b9e0f29e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f4bf78-fed2-4055-98ad-ac76725cf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:20 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Volume c52b40f5-0f69-4117-ac18-3393e60737c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52b40f5-0f69-4117-ac18-3393e60737c4', 'volume_size': 1} Jul 27 13:17:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:23 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0" returned: 0 in 6.007s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ece6b-7514-476c-9b62-5f9bed9f5ba9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:23 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:23 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:24 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.630s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:17:24 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Converted 1024.00 MB image at 170.40 MB/s Jul 27 13:17:24 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 is being set with open permissions: ugo+rw Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:24 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 Jul 27 13:17:24 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:24 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0" returned: 0 in 0.252s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-e6d5b192-76fc-4f4c-a57c-993ed238edf0" released by "_copy_volume_from_snapshot" :: held 7.883s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-d09c077b-e7d1-4b79-accf-c6d00e3b89aa-e6d5b192-76fc-4f4c-a57c-993ed238edf0" released by "_create_volume_from_snapshot" :: held 7.925s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.947s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.997s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2123723384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52b40f5-0f69-4117-ac18-3393e60737c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270595c216764c6aabd454783948237c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:20Z,use_quota=True,user_id='2d464e3c1ee04a7ab75cb7fcb7993bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Creating volume c52b40f5-0f69-4117-ac18-3393e60737c4 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:17:24 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:24 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 1073741824 Jul 27 13:17:24 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f6e706-1e03-4720-b6f5-7f8ab0fdbce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0', 'volume_size': 2, 'snapshot_id': 'd09c077b-e7d1-4b79-accf-c6d00e3b89aa'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec40abd-e076-4523-80dd-a638a24c069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Volume volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 (e6d5b192-76fc-4f4c-a57c-993ed238edf0): created successfully Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec40abd-e076-4523-80dd-a638a24c069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (038de32f-b8f7-486a-ad9c-739da5a6d383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0522e6eb-9cfd-4a8b-a7e5-b0761788087c tempest-VolumesSnapshotTestJSON-1896173882 None] Created volume successfully. Jul 27 13:17:25 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 1073741824" returned: 0 in 0.471s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:25 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 Jul 27 13:17:25 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:25 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4" returned: 0 in 0.298s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f4bf78-fed2-4055-98ad-ac76725cf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52b40f5-0f69-4117-ac18-3393e60737c4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20485165-5718-4cb9-9910-b14be84804bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Volume volume-c52b40f5-0f69-4117-ac18-3393e60737c4 (c52b40f5-0f69-4117-ac18-3393e60737c4): created successfully Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20485165-5718-4cb9-9910-b14be84804bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Flow 'volume_create_manager' (fcc270a2-6606-4a80-ae5f-71f3d7d9b023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fd2ebea1-1b98-464a-bc7a-407ade0fd456 tempest-AttachVolumeNegativeTest-1681737704 None] Created volume successfully. Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-e6d5b192-76fc-4f4c-a57c-993ed238edf0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-e6d5b192-76fc-4f4c-a57c-993ed238edf0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-e6d5b192-76fc-4f4c-a57c-993ed238edf0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-e6d5b192-76fc-4f4c-a57c-993ed238edf0" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbb568-d0f1-4fc1-bd27-dd27668cd51e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:25 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 Jul 27 13:17:25 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:26 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0" returned: 0 in 0.423s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:26 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0 Jul 27 13:17:26 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:26 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-e6d5b192-76fc-4f4c-a57c-993ed238edf0" returned: 0 in 0.313s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-e6d5b192-76fc-4f4c-a57c-993ed238edf0" released by "delete_volume" :: held 0.786s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['bbb1b9a3-6815-4c6b-9536-5d22ef1d715a', 'ad15ec68-0c09-4c74-924c-65de3ea60769', '803b71a1-1df0-4443-b888-af532080715c', '47ab69bf-8672-44d2-9d07-d6ab9213db90'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:26 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:26 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc1e6d8c-a185-4015-8e72-e42de7efb394 req-d1b9e3bd-d276-4681-8cef-221f3c8a5baf tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc1e6d8c-a185-4015-8e72-e42de7efb394 req-d1b9e3bd-d276-4681-8cef-221f3c8a5baf tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc1e6d8c-a185-4015-8e72-e42de7efb394 req-d1b9e3bd-d276-4681-8cef-221f3c8a5baf tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-bc1e6d8c-a185-4015-8e72-e42de7efb394 req-d1b9e3bd-d276-4681-8cef-221f3c8a5baf tempest-AttachVolumeNegativeTest-1681737704 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-c52b40f5-0f69-4117-ac18-3393e60737c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82316c18-2659-460b-9360-65cd52934ff8', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:17:26 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-bc1e6d8c-a185-4015-8e72-e42de7efb394 req-d1b9e3bd-d276-4681-8cef-221f3c8a5baf tempest-AttachVolumeNegativeTest-1681737704 None] attachment_update completed successfully. Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-d09c077b-e7d1-4b79-accf-c6d00e3b89aa-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-d09c077b-e7d1-4b79-accf-c6d00e3b89aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-36ffc672-6c5b-495d-8687-b60ae41c4f46" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-36ffc672-6c5b-495d-8687-b60ae41c4f46" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-d09c077b-e7d1-4b79-accf-c6d00e3b89aa" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:26 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:26 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleted volume successfully. Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-d09c077b-e7d1-4b79-accf-c6d00e3b89aa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleting offline snapshot d09c077b-e7d1-4b79-accf-c6d00e3b89aa of volume 36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] snapshot_file for this snap is: volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e16a17-95c9-4291-a0aa-7caba0e986d3]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0b66c0bc-5190-4e62-ba2b-27a1821c02f7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-e6d5b192-76fc-4f4c-a57c-993ed238edf0-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:27 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa Jul 27 13:17:27 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:27 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa" returned: 0 in 0.405s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ffc672-6c5b-495d-8687-b60ae41c4f46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:17:27 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[983513e3-e139-444c-b7bb-a1c5961ea3fd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:27 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:27 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:27 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.472s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:27 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa Jul 27 13:17:27 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:28 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa" returned: 0 in 0.483s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:28 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa Jul 27 13:17:28 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:28 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46.d09c077b-e7d1-4b79-accf-c6d00e3b89aa" returned: 0 in 0.304s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-d09c077b-e7d1-4b79-accf-c6d00e3b89aa" released by "_delete_snapshot" :: held 1.800s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-36ffc672-6c5b-495d-8687-b60ae41c4f46" released by "delete_snapshot" :: held 1.830s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['dc545e2c-e7b4-49b2-b900-8b2c5e6aae96', '9d1b122e-f16f-4997-8fa4-4340dd1ad7ca', 'dc1b8529-2a4a-409b-a486-4a5c95fbb405', 'd78059d9-d7e7-4170-8ad3-f04c93d05cee'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Delete snapshot completed successfully. Jul 27 13:17:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e84b341-b877-4192-b3bc-c81af4b1fe07 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-d09c077b-e7d1-4b79-accf-c6d00e3b89aa-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-36ffc672-6c5b-495d-8687-b60ae41c4f46-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-36ffc672-6c5b-495d-8687-b60ae41c4f46-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-36ffc672-6c5b-495d-8687-b60ae41c4f46" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-36ffc672-6c5b-495d-8687-b60ae41c4f46" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe2efd-ea66-487a-b4c6-c2b62bfc6c5b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:29 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:29 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:29 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.429s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:29 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46 Jul 27 13:17:29 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:29 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36ffc672-6c5b-495d-8687-b60ae41c4f46" returned: 0 in 0.276s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-36ffc672-6c5b-495d-8687-b60ae41c4f46" released by "delete_volume" :: held 0.775s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:29 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['f85f6203-7797-42bb-8585-11e5e22964e4', 'ab29dc53-9fef-404c-b18a-12089d9aed3b', '1e7e7c48-c3bb-438d-b988-ab69ec163590', '199ae664-6aad-47c1-8477-6b199b40a139'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:30 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:30 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:30 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.305s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleted volume successfully. Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-096d9a62-cb12-4f98-bc0d-d5b441e26840 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-36ffc672-6c5b-495d-8687-b60ae41c4f46-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (d1d04723-5a68-49c9-a193-896ff51bfd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ab3a46-e5ba-4144-a410-b62deabd3d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ab3a46-e5ba-4144-a410-b62deabd3d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1728557800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f3a794-a8c2-4f37-b812-fc85c1889183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:31Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65eab544-164d-40a1-812e-b976aa134f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65eab544-164d-40a1-812e-b976aa134f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acc7ff9-3079-4eb0-b24b-5409e4108b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acc7ff9-3079-4eb0-b24b-5409e4108b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f3a794-a8c2-4f37-b812-fc85c1889183', 'volume_name': 'volume-35f3a794-a8c2-4f37-b812-fc85c1889183', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6504fe-e2f1-45df-beef-29f0e599c601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6504fe-e2f1-45df-beef-29f0e599c601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945bae77-0a72-4146-b816-7d9f89c8ce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Volume 35f3a794-a8c2-4f37-b812-fc85c1889183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f3a794-a8c2-4f37-b812-fc85c1889183', 'volume_size': 1} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1728557800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f3a794-a8c2-4f37-b812-fc85c1889183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:31Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Creating volume 35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:17:31 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:31 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 1073741824 Jul 27 13:17:31 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:31 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 1073741824" returned: 0 in 0.500s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:31 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:31 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:31 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.270s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945bae77-0a72-4146-b816-7d9f89c8ce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f3a794-a8c2-4f37-b812-fc85c1889183', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c8e710-320d-4fab-92cd-938289063233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Volume volume-35f3a794-a8c2-4f37-b812-fc85c1889183 (35f3a794-a8c2-4f37-b812-fc85c1889183): created successfully Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c8e710-320d-4fab-92cd-938289063233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (d1d04723-5a68-49c9-a193-896ff51bfd99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1a17bbe6-e860-487a-a799-a9228884d27c tempest-VolumesSnapshotTestJSON-1896173882 None] Created volume successfully. Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:33 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:33 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:33 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 8 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Creating offline snapshot f3d7e5ce-c695-4ee1-a543-362a3b5b3395 of volume 35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf1a08-a52f-489e-a1a7-773e217d2170]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:33 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:33 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:34 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.571s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:34 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 1G Jul 27 13:17:34 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:34 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 1G" returned: 0 in 0.523s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3a794-a8c2-4f37-b812-fc85c1889183 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:34 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3a794-a8c2-4f37-b812-fc85c1889183 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 Jul 27 13:17:34 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:35 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3a794-a8c2-4f37-b812-fc85c1889183 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395" returned: 0 in 0.347s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:35 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 is being set with open permissions: ugo+rw Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:35 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 Jul 27 13:17:35 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:35 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395" returned: 0 in 0.324s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=94,cinder:UPDATE=109,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=107,cinder:SELECT=126,cinder:INSERT=23,cinder:DELETE=7 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:35 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info Jul 27 13:17:35 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:35 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info" returned: 0 in 0.307s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:35 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info is being set with open permissions: ugo+rw Jul 27 13:17:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:35 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info Jul 27 13:17:35 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:36 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.info" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:36 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-97caa876-8152-4316-8a06-a361c6d79539 tempest-VolumesSnapshotTestJSON-1896173882 None] Create snapshot completed successfully Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (c060e284-a677-451d-b658-85cd8902c63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d59f647-1e57-4fa6-bca4-f905d67fb917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d59f647-1e57-4fa6-bca4-f905d67fb917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-470765699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeadade-2757-4c1f-8bbd-bb33e2113e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cc3564f37a41eb8d8e5a06f6833281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3d7e5ce-c695-4ee1-a543-362a3b5b3395,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:38Z,use_quota=True,user_id='4cb3edd348514ada8d6733a54600d814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9a9338-dcba-4cdc-a00b-37fd0af8e7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9a9338-dcba-4cdc-a00b-37fd0af8e7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442c92e4-faee-4d51-88f4-b6e94145ddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442c92e4-faee-4d51-88f4-b6e94145ddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfeadade-2757-4c1f-8bbd-bb33e2113e0b', 'volume_name': 'volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b', 'volume_size': 1, 'snapshot_id': 'f3d7e5ce-c695-4ee1-a543-362a3b5b3395'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7c4c61-cedf-44ae-b349-11f5a99b5720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7c4c61-cedf-44ae-b349-11f5a99b5720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e83341f-7af7-43a5-8495-2a341d2ba0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Volume cfeadade-2757-4c1f-8bbd-bb33e2113e0b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b', 'volume_size': 1, 'snapshot_id': 'f3d7e5ce-c695-4ee1-a543-362a3b5b3395'} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-f3d7e5ce-c695-4ee1-a543-362a3b5b3395-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-f3d7e5ce-c695-4ee1-a543-362a3b5b3395-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Creating volume cfeadade-2757-4c1f-8bbd-bb33e2113e0b from snapshot f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] snapshot: f3d7e5ce-c695-4ee1-a543-362a3b5b3395, volume: cfeadade-2757-4c1f-8bbd-bb33e2113e0b, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c986777e-b8e1-4455-909b-5dc306d83d02]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:38 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 Jul 27 13:17:38 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:38 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395" returned: 0 in 0.483s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3a794-a8c2-4f37-b812-fc85c1889183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f021139-1e66-43e1-8346-55a44fb355f9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:38 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:38 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:38 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.413s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:17:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:38 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b Jul 27 13:17:38 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Flow 'volume_create_manager' (dc753100-fe68-4f03-8bd2-077a493adcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fe55b4-94da-40ee-90cb-bfbe163af41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fe55b4-94da-40ee-90cb-bfbe163af41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-556657833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549ce443-5aa3-47f4-99f0-d116decbaa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309a6e2009024daaaf376ecbf3d5621a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:42Z,use_quota=True,user_id='c4a06d67be904f1fbb3e0b33a5bc5cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fc9409-e125-422b-b624-005ed37517cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fc9409-e125-422b-b624-005ed37517cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f352514-a1db-4d8c-a6d6-4ed38d8da084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f352514-a1db-4d8c-a6d6-4ed38d8da084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549ce443-5aa3-47f4-99f0-d116decbaa89', 'volume_name': 'volume-549ce443-5aa3-47f4-99f0-d116decbaa89', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad1449a-1858-4037-8d18-d399bcc19339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad1449a-1858-4037-8d18-d399bcc19339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c28a15-1bcb-4fa8-aefe-6940c461bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:42 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Volume 549ce443-5aa3-47f4-99f0-d116decbaa89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549ce443-5aa3-47f4-99f0-d116decbaa89', 'volume_size': 1} Jul 27 13:17:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:45 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" returned: 0 in 6.757s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c768de61-ddd2-4614-a567-a9544f9ae935]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:45 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:45 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:46 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.620s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:17:46 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Converted 1024.00 MB image at 151.53 MB/s Jul 27 13:17:46 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b is being set with open permissions: ugo+rw Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:46 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b Jul 27 13:17:46 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:46 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" returned: 0 in 0.248s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" released by "_copy_volume_from_snapshot" :: held 8.629s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-f3d7e5ce-c695-4ee1-a543-362a3b5b3395-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" released by "_create_volume_from_snapshot" :: held 8.663s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.705s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.886s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-556657833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549ce443-5aa3-47f4-99f0-d116decbaa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309a6e2009024daaaf376ecbf3d5621a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:17:42Z,use_quota=True,user_id='c4a06d67be904f1fbb3e0b33a5bc5cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Creating volume 549ce443-5aa3-47f4-99f0-d116decbaa89 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:17:46 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:46 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 1073741824 Jul 27 13:17:46 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e83341f-7af7-43a5-8495-2a341d2ba0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b', 'volume_size': 1, 'snapshot_id': 'f3d7e5ce-c695-4ee1-a543-362a3b5b3395'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c972301-e46c-4935-98c7-11529bd371a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:46 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Volume volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b (cfeadade-2757-4c1f-8bbd-bb33e2113e0b): created successfully Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c972301-e46c-4935-98c7-11529bd371a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Flow 'volume_create_manager' (c060e284-a677-451d-b658-85cd8902c63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8fb3a93c-b2c8-4f95-b6c7-54b5dd645e16 tempest-VolumesSnapshotTestJSON-1896173882 None] Created volume successfully. Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-cfeadade-2757-4c1f-8bbd-bb33e2113e0b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-cfeadade-2757-4c1f-8bbd-bb33e2113e0b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:47 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 1073741824" returned: 0 in 0.559s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:47 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 Jul 27 13:17:47 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e1004-9138-474f-b29e-b0fc392991ab]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:47 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b Jul 27 13:17:47 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:47 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c28a15-1bcb-4fa8-aefe-6940c461bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549ce443-5aa3-47f4-99f0-d116decbaa89', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d0dd96-f5eb-4619-8d20-d2f505018c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:17:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Volume volume-549ce443-5aa3-47f4-99f0-d116decbaa89 (549ce443-5aa3-47f4-99f0-d116decbaa89): created successfully Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d0dd96-f5eb-4619-8d20-d2f505018c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Flow 'volume_create_manager' (dc753100-fe68-4f03-8bd2-077a493adcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:17:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cffa2acd-b453-4fc1-9411-ab9c6b2fc032 tempest-VolumesServicesTestJSON-2091767264 None] Created volume successfully. Jul 27 13:17:47 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" returned: 0 in 0.519s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:47 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b Jul 27 13:17:47 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Acquiring lock "cinder-549ce443-5aa3-47f4-99f0-d116decbaa89-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Lock "cinder-549ce443-5aa3-47f4-99f0-d116decbaa89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Acquiring lock "cinder-quobyte-549ce443-5aa3-47f4-99f0-d116decbaa89" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Lock "cinder-quobyte-549ce443-5aa3-47f4-99f0-d116decbaa89" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:48 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-02e58374-136b-4d01-a4a5-9eb9eb1d63b4 req-f6e3a087-e8bc-4252-b895-fe61b7d9f546 tempest-AttachVolumeTestJSON-570659394 None] Terminate volume connection completed successfully. Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-02e58374-136b-4d01-a4a5-9eb9eb1d63b4 req-f6e3a087-e8bc-4252-b895-fe61b7d9f546 tempest-AttachVolumeTestJSON-570659394 None] Deleting attachment 0575ffc4-5eb5-44b2-a70c-3e827c15a8f7. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" returned: 0 in 0.385s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b1fca0-5a14-4fec-a072-a0cab7ae57c0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-cfeadade-2757-4c1f-8bbd-bb33e2113e0b" released by "delete_volume" :: held 0.971s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['3ef7ac8c-c3ba-4a77-85f6-6c6d82302a7b', 'c47d089d-32e3-476a-b4e5-307ad4bb41e9', '1293f5f4-3eed-4f13-890c-19c0cf05128f', '22268376-0c7f-402a-83c0-3a1d4a8378b5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:48 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 Jul 27 13:17:48 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:48 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:48 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:48 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89" returned: 0 in 0.562s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:48 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89 Jul 27 13:17:48 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:48 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.371s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleted volume successfully. Jul 27 13:17:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0632340-1938-4ad3-87f5-ce572ee09b71 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-cfeadade-2757-4c1f-8bbd-bb33e2113e0b-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:49 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-549ce443-5aa3-47f4-99f0-d116decbaa89" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Lock "cinder-quobyte-549ce443-5aa3-47f4-99f0-d116decbaa89" released by "delete_volume" :: held 0.996s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Created reservations ['0c5f7a36-c721-4014-ad4a-1bb2f657e083', '9d7d651e-5313-4e5a-888b-4ea6ba81ce7d', 'ac768e9d-2a02-417f-a18f-dab93f3c87f3', 'ad291682-8c98-4330-aec4-27b1706b1b92'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:49 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:49 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-f3d7e5ce-c695-4ee1-a543-362a3b5b3395-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-f3d7e5ce-c695-4ee1-a543-362a3b5b3395-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-35f3a794-a8c2-4f37-b812-fc85c1889183" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:49 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-35f3a794-a8c2-4f37-b812-fc85c1889183" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-f3d7e5ce-c695-4ee1-a543-362a3b5b3395" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.311s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Deleted volume successfully. Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-f3d7e5ce-c695-4ee1-a543-362a3b5b3395" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleting offline snapshot f3d7e5ce-c695-4ee1-a543-362a3b5b3395 of volume 35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] snapshot_file for this snap is: volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4a3c932e-7f77-4fd9-ac1c-7d530ce38e2e tempest-VolumesServicesTestJSON-2091767264 None] Lock "cinder-549ce443-5aa3-47f4-99f0-d116decbaa89-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d491cb-c368-45c9-8468-83956f61f52b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:49 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 Jul 27 13:17:49 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:49 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395" returned: 0 in 0.367s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3a794-a8c2-4f37-b812-fc85c1889183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca553b2-6262-4311-a7c0-d0177425a7d9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:50 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:50 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:50 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.588s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:50 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 Jul 27 13:17:50 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:51 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395" returned: 0 in 0.479s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:51 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395 Jul 27 13:17:51 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:51 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183.f3d7e5ce-c695-4ee1-a543-362a3b5b3395" returned: 0 in 0.309s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-f3d7e5ce-c695-4ee1-a543-362a3b5b3395" released by "_delete_snapshot" :: held 1.874s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-35f3a794-a8c2-4f37-b812-fc85c1889183" released by "delete_snapshot" :: held 1.921s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['7f9ba239-d219-4265-9d95-8b3f48e4216b', 'd337347d-f9e4-4ce6-8722-425d8533c339', 'b0735908-da56-45de-be95-7e89b3e2705a', 'e9cc2726-e482-43b4-9e55-699585ac1472'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:51 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Delete snapshot completed successfully. Jul 27 13:17:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9220ed1d-77c3-4acd-8e3d-cad4cee54137 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-f3d7e5ce-c695-4ee1-a543-362a3b5b3395-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-35f3a794-a8c2-4f37-b812-fc85c1889183-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-35f3a794-a8c2-4f37-b812-fc85c1889183-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-35f3a794-a8c2-4f37-b812-fc85c1889183" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-35f3a794-a8c2-4f37-b812-fc85c1889183" acquired by "delete_volume" :: waited 0.047s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2542db1d-0d14-42de-91bf-ea7d41b9ecb5]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:52 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:52 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:52 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.598s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:52 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183 Jul 27 13:17:52 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:53 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35f3a794-a8c2-4f37-b812-fc85c1889183" returned: 0 in 0.513s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-35f3a794-a8c2-4f37-b812-fc85c1889183" released by "delete_volume" :: held 1.214s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['0f4fcb0d-5591-43e8-a3af-edeef67a3637', 'ebbc45e8-b1cc-4c86-a58c-70053075ff90', '4ff724f5-f7e6-45f3-b91e-c94b1cb5e352', '78439ff6-2e82-487c-b835-82342f74331c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:53 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:53 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:53 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleted volume successfully. Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c8d3df93-d776-4c67-b1a3-d13cfaa68814 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-35f3a794-a8c2-4f37-b812-fc85c1889183-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-b919114c-e557-49ab-b71a-e8f81d08486c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-b919114c-e557-49ab-b71a-e8f81d08486c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "cinder-quobyte-b919114c-e557-49ab-b71a-e8f81d08486c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-b919114c-e557-49ab-b71a-e8f81d08486c" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b57eb-6674-4758-bf86-f3a3ae683d21]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:17:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:54 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c Jul 27 13:17:54 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:55 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c" returned: 0 in 0.444s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:55 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c Jul 27 13:17:55 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:55 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b919114c-e557-49ab-b71a-e8f81d08486c" returned: 0 in 0.336s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-quobyte-b919114c-e557-49ab-b71a-e8f81d08486c" released by "delete_volume" :: held 0.862s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Created reservations ['f706fc72-5fa2-406b-acde-518e158f2488', 'dca684ef-63eb-4892-b3b2-b47e2cc9ba3b', '5070fd05-a994-40db-b60e-ed1a5b0aaa33', '7ade9c95-0540-4889-bfdf-ba8164a78b1d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:17:55 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:17:55 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:17:55 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.313s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:17:55 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:17:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Deleted volume successfully. Jul 27 13:17:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0414ed62-abf7-4116-8011-6db9e80912d7 tempest-VolumesSnapshotTestJSON-1896173882 None] Lock "cinder-b919114c-e557-49ab-b71a-e8f81d08486c-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Flow 'volume_create_manager' (9f1794db-c9c5-4324-b7c7-f87f9d569ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eb95fb-450b-4de1-bbeb-c92bcfbc310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eb95fb-450b-4de1-bbeb-c92bcfbc310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-380095657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6e029f-0af8-41ef-a12f-5872ac8323d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9597c89671ec42f78771642dfad3b573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:04Z,use_quota=True,user_id='b435e0b380e14748aa687fd19bce210d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468debf8-c754-4890-b0af-013c2ccd83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468debf8-c754-4890-b0af-013c2ccd83a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c827891e-0754-4ff9-aeb2-e8404ec8dcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c827891e-0754-4ff9-aeb2-e8404ec8dcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6e029f-0af8-41ef-a12f-5872ac8323d8', 'volume_name': 'volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8', 'volume_size': 2}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d1fb42-a77f-4b86-8016-09548f2b6f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d1fb42-a77f-4b86-8016-09548f2b6f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497a64c5-f1a5-4b74-bae9-39e33218f3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Volume 8c6e029f-0af8-41ef-a12f-5872ac8323d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8', 'volume_size': 2} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-380095657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6e029f-0af8-41ef-a12f-5872ac8323d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9597c89671ec42f78771642dfad3b573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:04Z,use_quota=True,user_id='b435e0b380e14748aa687fd19bce210d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Creating volume 8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:04 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 2147483648 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:04 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 2147483648 Jul 27 13:18:04 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:05 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 2147483648" returned: 0 in 0.603s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:05 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 Jul 27 13:18:05 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:05 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497a64c5-f1a5-4b74-bae9-39e33218f3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8', 'volume_size': 2}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55431f09-4d73-47ba-8f69-8f8e930aa323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Volume volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 (8c6e029f-0af8-41ef-a12f-5872ac8323d8): created successfully Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55431f09-4d73-47ba-8f69-8f8e930aa323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Flow 'volume_create_manager' (9f1794db-c9c5-4324-b7c7-f87f9d569ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5089c2f4-5643-45cf-b5ee-5b8005b4d1b5 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Created volume successfully. Jul 27 13:18:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Creating offline snapshot 323c4ccd-425d-48ef-823d-7297f96f3721 of volume 8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:18:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61e0b5-b273-4715-a036-148c779ef638]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:07 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 Jul 27 13:18:07 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:07 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8" returned: 0 in 0.556s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 2G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:07 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 2G Jul 27 13:18:07 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:08 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 2G" returned: 0 in 0.795s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:08 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 Jul 27 13:18:08 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:08 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721" returned: 0 in 0.383s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:08 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 is being set with open permissions: ugo+rw Jul 27 13:18:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:08 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 Jul 27 13:18:08 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:08 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:09 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info Jul 27 13:18:09 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:09 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info" returned: 0 in 0.324s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:09 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info is being set with open permissions: ugo+rw Jul 27 13:18:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:09 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info Jul 27 13:18:09 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:09 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.info" returned: 0 in 0.283s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-98c71360-139f-4f4d-9c1c-da70c02f590e tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Create snapshot completed successfully Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "cinder-323c4ccd-425d-48ef-823d-7297f96f3721-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-323c4ccd-425d-48ef-823d-7297f96f3721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "cinder-quobyte-8c6e029f-0af8-41ef-a12f-5872ac8323d8" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-quobyte-8c6e029f-0af8-41ef-a12f-5872ac8323d8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "cinder-quobyte-323c4ccd-425d-48ef-823d-7297f96f3721" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-quobyte-323c4ccd-425d-48ef-823d-7297f96f3721" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Deleting offline snapshot 323c4ccd-425d-48ef-823d-7297f96f3721 of volume 8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] snapshot_file for this snap is: volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73ec479-294b-475f-b2e2-16dca95c4c9c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:10 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 Jul 27 13:18:10 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:10 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721" returned: 0 in 0.461s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8e9ff-fb3a-4ea2-9d3a-b5b24f0d3b9f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:11 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 Jul 27 13:18:11 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:11 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8" returned: 0 in 0.507s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:11 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 Jul 27 13:18:11 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:11 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721" returned: 0 in 0.386s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:11 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721 Jul 27 13:18:11 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-f452da4f-f807-4a05-b71e-6056a5e7bad1 req-44a52291-82cd-4689-aaff-1bbc6e588ad7 tempest-AttachVolumeNegativeTest-1681737704 None] Terminate volume connection completed successfully. Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-f452da4f-f807-4a05-b71e-6056a5e7bad1 req-44a52291-82cd-4689-aaff-1bbc6e588ad7 tempest-AttachVolumeNegativeTest-1681737704 None] Deleting attachment 82316c18-2659-460b-9360-65cd52934ff8. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:18:12 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8.323c4ccd-425d-48ef-823d-7297f96f3721" returned: 0 in 0.303s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-quobyte-323c4ccd-425d-48ef-823d-7297f96f3721" released by "_delete_snapshot" :: held 1.810s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-quobyte-8c6e029f-0af8-41ef-a12f-5872ac8323d8" released by "delete_snapshot" :: held 1.845s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Created reservations ['fd4013ea-8c41-4b99-970c-1cf8a3fdde09', '99bf5524-864b-40fc-9b00-f45c3dd7c8e5', 'c07d19e0-1b24-43bb-aec8-fd3ff331d2e7', 'b69fd6bf-fd17-447e-9ccf-a385019ba494'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:18:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Delete snapshot completed successfully. Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a5249d30-d76e-40ac-8e10-1d0e13571f32 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-323c4ccd-425d-48ef-823d-7297f96f3721-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "cinder-8c6e029f-0af8-41ef-a12f-5872ac8323d8-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-8c6e029f-0af8-41ef-a12f-5872ac8323d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "cinder-quobyte-8c6e029f-0af8-41ef-a12f-5872ac8323d8" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-quobyte-8c6e029f-0af8-41ef-a12f-5872ac8323d8" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c3ddb-4525-4117-be2a-975cd0f9869c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:12 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 Jul 27 13:18:12 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:13 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8" returned: 0 in 0.433s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:13 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8 Jul 27 13:18:13 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:13 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8c6e029f-0af8-41ef-a12f-5872ac8323d8" returned: 0 in 0.459s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-quobyte-8c6e029f-0af8-41ef-a12f-5872ac8323d8" released by "delete_volume" :: held 0.976s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Created reservations ['362e0642-5a4b-4786-8768-a6493f0a9138', '21e55b7b-0c09-462e-a4b2-71406b59b7ec', 'bf4f8162-3c8d-4f4f-ad67-6429abc5e068', '44382115-cdfd-4f28-8bad-d229ff5202d5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:13 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:18:13 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:14 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.294s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:14 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:18:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Deleted volume successfully. Jul 27 13:18:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cbabbc16-6d6a-468f-96d9-73a7faa60bb1 tempest-VolumesSnapshotNegativeTestJSON-964271914 None] Lock "cinder-8c6e029f-0af8-41ef-a12f-5872ac8323d8-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:23 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=49,cinder:DELETE=5,cinder:UPDATE=53,cinder:INSERT=17 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=50,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=5 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Flow 'volume_create_manager' (08f3629f-92ed-43dd-8765-990ab793595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed2ae8-f084-43d8-ba81-8944aeac8e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed2ae8-f084-43d8-ba81-8944aeac8e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce056f24-cffb-43b5-bbdc-2997d719a186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c36710cbee534d269b933e8fb416e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:24Z,use_quota=True,user_id='fa4be58e6ce94e9e96327ca8ba44c228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81b64752-6f39-4dbf-a537-1efd8e704d98),volume_type_id=81b64752-6f39-4dbf-a537-1efd8e704d98)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c514b5-709f-4959-9549-90125ab4574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c514b5-709f-4959-9549-90125ab4574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d38bab-1f99-4fd0-ad8c-862c75092b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:18:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d38bab-1f99-4fd0-ad8c-862c75092b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce056f24-cffb-43b5-bbdc-2997d719a186', 'volume_name': 'volume-ce056f24-cffb-43b5-bbdc-2997d719a186', 'volume_size': 1, 'image_id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f7e5e5686551e1672af5e5511706164', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c36710cbee534d269b933e8fb416e7d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a5bc86e021f8a581536683e6416ea3150ee7ad812ddb16873ad94744f303d9a09ce6088424cb0e48b94258ffacd80f2e68b4d187c4ea6d38f6f97dea230b991', 'id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'created_at': datetime.datetime(2026, 7, 27, 11, 18, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 18, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d773c4e6-0aaa-4444-a8d8-0b11755cf841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d773c4e6-0aaa-4444-a8d8-0b11755cf841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9adefc-f6f0-4f48-8b91-8d6089653976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Volume ce056f24-cffb-43b5-bbdc-2997d719a186: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce056f24-cffb-43b5-bbdc-2997d719a186', 'volume_size': 1, 'image_id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f7e5e5686551e1672af5e5511706164', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c36710cbee534d269b933e8fb416e7d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a5bc86e021f8a581536683e6416ea3150ee7ad812ddb16873ad94744f303d9a09ce6088424cb0e48b94258ffacd80f2e68b4d187c4ea6d38f6f97dea230b991', 'id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'created_at': datetime.datetime(2026, 7, 27, 11, 18, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 18, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Trying to clone ce056f24-cffb-43b5-bbdc-2997d719a186 from image 0aa09d3b-9700-41a7-9d92-a25b44d55e6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:18:25 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Image download 0.00 MB at 0.00 MB/s Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6addb7d5-ba41-49d6-ac08-1bd2eb4f19db]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:25 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD Jul 27 13:18:25 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:25 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:25 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD Jul 27 13:18:25 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:26 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Temporary image 0aa09d3b-9700-41a7-9d92-a25b44d55e6e is fetched for user fa4be58e6ce94e9e96327ca8ba44c228. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[55106596-8d36-4ebd-b3ff-f741f71ba474]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:26 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD Jul 27 13:18:26 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:26 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:27 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD Jul 27 13:18:27 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:27 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD" returned: 1 in 0.574s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce056f24-cffb-43b5-bbdc-2997d719a186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c36710cbee534d269b933e8fb416e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:24Z,use_quota=True,user_id='fa4be58e6ce94e9e96327ca8ba44c228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81b64752-6f39-4dbf-a537-1efd8e704d98),volume_type_id=81b64752-6f39-4dbf-a537-1efd8e704d98)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Creating volume ce056f24-cffb-43b5-bbdc-2997d719a186 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:27 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:27 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 1073741824 Jul 27 13:18:27 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:28 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 1073741824" returned: 0 in 0.633s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:28 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 Jul 27 13:18:28 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:28 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186" returned: 0 in 0.282s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Attempting download of 0aa09d3b-9700-41a7-9d92-a25b44d55e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'metadata': {}}])) to volume ce056f24-cffb-43b5-bbdc-2997d719a186. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec396405-3e25-4fb8-9f11-bd750ec86039]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:28 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi Jul 27 13:18:28 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:29 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:29 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi Jul 27 13:18:29 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:29 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi" returned: 1 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_whru96hi' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe337a-b6a0-4f20-b622-9d70184b0398]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:29 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD Jul 27 13:18:29 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:29 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:29 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD Jul 27 13:18:29 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:30 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] 0aa09d3b-9700-41a7-9d92-a25b44d55e6e was raw, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:30 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 Jul 27 13:18:30 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:30 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186" returned: 0 in 0.587s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0aa09d3b-9700-41a7-9d92-a25b44d55e6e_5s2rd4tsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:18:30 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Converted 0.00 MB image at 0.00 MB/s Jul 27 13:18:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:30 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 1G Jul 27 13:18:30 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:31 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 1G" returned: 0 in 0.751s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Downloaded image 0aa09d3b-9700-41a7-9d92-a25b44d55e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'metadata': {}}])) to volume ce056f24-cffb-43b5-bbdc-2997d719a186 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Temporary image 0aa09d3b-9700-41a7-9d92-a25b44d55e6e for user fa4be58e6ce94e9e96327ca8ba44c228 is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Marking volume ce056f24-cffb-43b5-bbdc-2997d719a186 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Copying metadata from image 0aa09d3b-9700-41a7-9d92-a25b44d55e6e to ce056f24-cffb-43b5-bbdc-2997d719a186. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Creating volume glance metadata for volume ce056f24-cffb-43b5-bbdc-2997d719a186 backed by image 0aa09d3b-9700-41a7-9d92-a25b44d55e6e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4f7e5e5686551e1672af5e5511706164', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9adefc-f6f0-4f48-8b91-8d6089653976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce056f24-cffb-43b5-bbdc-2997d719a186', 'volume_size': 1, 'image_id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f7e5e5686551e1672af5e5511706164', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c36710cbee534d269b933e8fb416e7d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a5bc86e021f8a581536683e6416ea3150ee7ad812ddb16873ad94744f303d9a09ce6088424cb0e48b94258ffacd80f2e68b4d187c4ea6d38f6f97dea230b991', 'id': '0aa09d3b-9700-41a7-9d92-a25b44d55e6e', 'created_at': datetime.datetime(2026, 7, 27, 11, 18, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 18, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0aa09d3b-9700-41a7-9d92-a25b44d55e6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45540b97-684b-47a9-be46-ce43ca494e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Volume volume-ce056f24-cffb-43b5-bbdc-2997d719a186 (ce056f24-cffb-43b5-bbdc-2997d719a186): created successfully Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45540b97-684b-47a9-be46-ce43ca494e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Flow 'volume_create_manager' (08f3629f-92ed-43dd-8765-990ab793595f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-573c8dad-fd8d-47fb-bd57-58d309214b0b tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Created volume successfully. Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Acquiring lock "cinder-ce056f24-cffb-43b5-bbdc-2997d719a186-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "cinder-ce056f24-cffb-43b5-bbdc-2997d719a186-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Acquiring lock "cinder-quobyte-ce056f24-cffb-43b5-bbdc-2997d719a186" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "cinder-quobyte-ce056f24-cffb-43b5-bbdc-2997d719a186" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00254b1-c331-43fa-8612-04f8e11ad8d6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:32 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 Jul 27 13:18:32 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:32 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186" returned: 0 in 0.779s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:32 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186 Jul 27 13:18:32 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:33 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:18:33 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:33 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ce056f24-cffb-43b5-bbdc-2997d719a186" returned: 0 in 0.550s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "cinder-quobyte-ce056f24-cffb-43b5-bbdc-2997d719a186" released by "delete_volume" :: held 1.412s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:33 devstack cinder-volume[88202]: WARNING cinder.quota [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:18:33 devstack cinder-volume[88202]: WARNING cinder.quota [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Created reservations ['f8e03240-6f71-4d9d-b3d0-206d2fbabd2f', '8f633fbc-6e6d-4bb9-9b1f-019a430f1cbd', '78789057-ed62-45dc-9cbc-ec30a351a346', 'b9a2eb3f-9c68-4105-9af0-3e5a498450a0'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:18:33 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.637s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:33 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:18:33 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:34 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.381s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:34 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:18:34 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Deleted volume successfully. Jul 27 13:18:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d40046f0-fa42-4af3-bda6-68f8a32eebfd tempest-VolumeAndVolumeTypeFromImageTest-1378052684 None] Lock "cinder-ce056f24-cffb-43b5-bbdc-2997d719a186-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (bd92f7f1-262a-4209-b63c-5a9834b006bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815aa674-5dcf-4fe9-ab7f-28899a4f0a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815aa674-5dcf-4fe9-ab7f-28899a4f0a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1752535745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac0c21e-5129-44df-b7b8-28d2dc95ad86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:39Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a034e-0055-4a00-9555-c40794ae46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a034e-0055-4a00-9555-c40794ae46a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c3fdd6-e46b-49fd-ade0-7b56c5f589ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c3fdd6-e46b-49fd-ade0-7b56c5f589ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac0c21e-5129-44df-b7b8-28d2dc95ad86', 'volume_name': 'volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10c0d78-9512-4daf-a1ef-19e97195a9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10c0d78-9512-4daf-a1ef-19e97195a9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35ef9b0-ac96-459c-9b67-c40a96a6b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:39 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Volume 4ac0c21e-5129-44df-b7b8-28d2dc95ad86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86', 'volume_size': 1} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1752535745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac0c21e-5129-44df-b7b8-28d2dc95ad86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:39Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Creating volume 4ac0c21e-5129-44df-b7b8-28d2dc95ad86 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:39 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:39 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 1073741824 Jul 27 13:18:39 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:41 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 1073741824" returned: 0 in 1.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:41 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 Jul 27 13:18:41 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:41 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" returned: 0 in 0.398s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35ef9b0-ac96-459c-9b67-c40a96a6b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48ee01e-3712-4a54-a656-cab6b76af383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:41 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Volume volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 (4ac0c21e-5129-44df-b7b8-28d2dc95ad86): created successfully Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48ee01e-3712-4a54-a656-cab6b76af383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (bd92f7f1-262a-4209-b63c-5a9834b006bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3b7f74db-5a68-49a0-b334-96ca73a80c2d tempest-VolumesActionsTest-1389628003 None] Created volume successfully. Jul 27 13:18:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-54320877-ad3c-4c9a-b17c-b267eaab06c4 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" by "attach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-54320877-ad3c-4c9a-b17c-b267eaab06c4 tempest-VolumesActionsTest-1389628003 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" acquired by "attach_volume" :: waited 0.045s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-54320877-ad3c-4c9a-b17c-b267eaab06c4 tempest-VolumesActionsTest-1389628003 None] Attaching volume 4ac0c21e-5129-44df-b7b8-28d2dc95ad86 to instance 14245b98-6310-4c08-bc75-e1bc257d8718 at mountpoint /dev/vdb on host None. Jul 27 13:18:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-54320877-ad3c-4c9a-b17c-b267eaab06c4 tempest-VolumesActionsTest-1389628003 None] Attach volume completed successfully. Jul 27 13:18:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-54320877-ad3c-4c9a-b17c-b267eaab06c4 tempest-VolumesActionsTest-1389628003 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" released by "attach_volume" :: held 0.264s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-95b34dc5-362b-4963-8b6a-308a6730c8a6 tempest-VolumesActionsTest-3137151 None] Terminate volume connection completed successfully. Jul 27 13:18:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-95b34dc5-362b-4963-8b6a-308a6730c8a6 tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-detach_volume" by "detach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-95b34dc5-362b-4963-8b6a-308a6730c8a6 tempest-VolumesActionsTest-3137151 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-95b34dc5-362b-4963-8b6a-308a6730c8a6 tempest-VolumesActionsTest-3137151 None] Detaching volume 4ac0c21e-5129-44df-b7b8-28d2dc95ad86 from instance 14245b98-6310-4c08-bc75-e1bc257d8718. Jul 27 13:18:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-95b34dc5-362b-4963-8b6a-308a6730c8a6 tempest-VolumesActionsTest-3137151 None] Detach volume completed successfully. Jul 27 13:18:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-95b34dc5-362b-4963-8b6a-308a6730c8a6 tempest-VolumesActionsTest-3137151 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-detach_volume" released by "detach_volume" :: held 0.174s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d3578f24-7c91-4050-ba15-3cf17f14cf5f tempest-VolumesActionsTest-1389628003 None] Acquiring lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-detach_volume" by "detach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d3578f24-7c91-4050-ba15-3cf17f14cf5f tempest-VolumesActionsTest-1389628003 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d3578f24-7c91-4050-ba15-3cf17f14cf5f tempest-VolumesActionsTest-1389628003 None] Volume detach called, but volume not attached. Jul 27 13:18:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d3578f24-7c91-4050-ba15-3cf17f14cf5f tempest-VolumesActionsTest-1389628003 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Acquiring lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Acquiring lock "cinder-quobyte-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Lock "cinder-quobyte-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804cef4-2b79-4c26-b006-dc32fe242358]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (6c0f62cb-546e-4580-9af0-87e045f3f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d982c8-734e-40e0-8f7c-5b2dbf3bb24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d982c8-734e-40e0-8f7c-5b2dbf3bb24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083212937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:47Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069ddb10-e791-4698-86c2-f9db1a2d832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:47 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 Jul 27 13:18:47 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069ddb10-e791-4698-86c2-f9db1a2d832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0a1f26-ad11-431d-83c5-38cf0137e761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0a1f26-ad11-431d-83c5-38cf0137e761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505', 'volume_name': 'volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1cfe11-8869-4d10-834d-3dba8fde49fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1cfe11-8869-4d10-834d-3dba8fde49fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b139044c-2ba8-4256-a23f-28b4f5b04cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume 0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505', 'volume_size': 1} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083212937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:47Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Creating volume 0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:47 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:47 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 1073741824 Jul 27 13:18:47 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:47 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" returned: 0 in 1.074s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:47 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86 Jul 27 13:18:47 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:48 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" returned: 0 in 0.400s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Lock "cinder-quobyte-4ac0c21e-5129-44df-b7b8-28d2dc95ad86" released by "delete_volume" :: held 1.592s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:48 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Created reservations ['bfc78fb9-f77b-46e0-a6ca-fd0471216a54', '42348010-f0aa-4580-bc5d-31de4e25b08b', '9bc1fd70-60e9-4ae8-9681-03e5ce697972', 'cbbdcc93-2b61-4030-8aee-fff40c5fac05'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 1073741824" returned: 0 in 1.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:48 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 Jul 27 13:18:48 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:48 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:18:48 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:49 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505" returned: 0 in 0.609s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b139044c-2ba8-4256-a23f-28b4f5b04cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecf0d86-673c-4a82-b47b-ab62df576447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:49 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 (0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505): created successfully Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecf0d86-673c-4a82-b47b-ab62df576447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (6c0f62cb-546e-4580-9af0-87e045f3f131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b5dd9a68-9459-4873-aa92-57d7a893b48a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created volume successfully. Jul 27 13:18:49 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.830s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:18:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Deleted volume successfully. Jul 27 13:18:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-348bcc20-bd2f-4069-8d9a-e22d690d831f tempest-VolumesActionsTest-1389628003 None] Lock "cinder-4ac0c21e-5129-44df-b7b8-28d2dc95ad86-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (e81d9a96-7156-4b98-9405-eba108ebff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c3de61-cbb7-455e-8498-4487b402206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c3de61-cbb7-455e-8498-4487b402206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164709464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54936bfe-4eea-4ce2-9e3f-21a10f74137a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:51Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add7422c-049c-4a87-b438-a33dc7e12e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add7422c-049c-4a87-b438-a33dc7e12e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c048517b-4733-45f7-aeac-f76e9a8b7b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c048517b-4733-45f7-aeac-f76e9a8b7b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54936bfe-4eea-4ce2-9e3f-21a10f74137a', 'volume_name': 'volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a93967-54dc-4816-8183-edad773bdfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a93967-54dc-4816-8183-edad773bdfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb27e854-df43-413f-9b6c-e9af9ddcc3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume 54936bfe-4eea-4ce2-9e3f-21a10f74137a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a', 'volume_size': 1} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164709464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54936bfe-4eea-4ce2-9e3f-21a10f74137a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:51Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Creating volume 54936bfe-4eea-4ce2-9e3f-21a10f74137a {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:51 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:51 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a 1073741824 Jul 27 13:18:51 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (aade08b1-b274-4f2a-a596-eb5531a6f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac28e9e9-5fcc-4e84-8156-517318b4e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac28e9e9-5fcc-4e84-8156-517318b4e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783513793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e9d680-c4e0-4b07-8c80-dbdfac4b58c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:52Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5559efaf-7aab-4d6b-a19a-738770a48322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5559efaf-7aab-4d6b-a19a-738770a48322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb36f45b-1b9f-457d-8f38-7dfd981dcc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb36f45b-1b9f-457d-8f38-7dfd981dcc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e9d680-c4e0-4b07-8c80-dbdfac4b58c1', 'volume_name': 'volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50fda8c-06bb-4be1-9b28-8cb577cfe722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50fda8c-06bb-4be1-9b28-8cb577cfe722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbf0cdc-0f5e-4c58-9955-99ce811ad156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume 41e9d680-c4e0-4b07-8c80-dbdfac4b58c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1', 'volume_size': 1} Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:52 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a 1073741824" returned: 0 in 1.186s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:53 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a Jul 27 13:18:53 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (ecb92c9a-76eb-4c7a-9ccc-6e0228ef53fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c9b045-35bf-4799-a374-698a7083a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c9b045-35bf-4799-a374-698a7083a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59715869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b21206f-0b75-4b31-b912-b44703ca7482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:53Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28a0be0-fef5-4cc9-853a-ca30378216f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28a0be0-fef5-4cc9-853a-ca30378216f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca1d0d-bd79-4333-bb85-72b7faf642cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca1d0d-bd79-4333-bb85-72b7faf642cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b21206f-0b75-4b31-b912-b44703ca7482', 'volume_name': 'volume-8b21206f-0b75-4b31-b912-b44703ca7482', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1972e845-954c-43ed-b97a-679d9e10f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1972e845-954c-43ed-b97a-679d9e10f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf3f28d-149c-4fab-9f3f-a99965477ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume 8b21206f-0b75-4b31-b912-b44703ca7482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b21206f-0b75-4b31-b912-b44703ca7482', 'volume_size': 1} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:53 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a" returned: 0 in 0.402s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.346s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783513793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e9d680-c4e0-4b07-8c80-dbdfac4b58c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:52Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Creating volume 41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:53 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb27e854-df43-413f-9b6c-e9af9ddcc3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 1073741824 Jul 27 13:18:53 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3516df-1785-4b06-80d2-395a63176f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a (54936bfe-4eea-4ce2-9e3f-21a10f74137a): created successfully Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3516df-1785-4b06-80d2-395a63176f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (e81d9a96-7156-4b98-9405-eba108ebff77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3476d484-80c2-4588-973c-93f4a3e91940 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created volume successfully. Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (e4acb614-63e2-45c7-89ab-fe2a3e209ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea1e7a-2f3a-40bd-9436-beedf3456f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea1e7a-2f3a-40bd-9436-beedf3456f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304250223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e6ca5d-0c3b-477c-a86e-cf634bab837f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:54Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beef1d54-c114-40d3-ae83-9c68228060cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beef1d54-c114-40d3-ae83-9c68228060cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58464910-4da3-4363-82e8-4c5e06dc553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58464910-4da3-4363-82e8-4c5e06dc553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e6ca5d-0c3b-477c-a86e-cf634bab837f', 'volume_name': 'volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8c28d8-4c22-4819-bd38-d97b5265a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8c28d8-4c22-4819-bd38-d97b5265a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e645fbbd-dc3e-49b0-a47f-724e04e764f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume 30e6ca5d-0c3b-477c-a86e-cf634bab837f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f', 'volume_size': 1} Jul 27 13:18:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:54 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 1073741824" returned: 0 in 0.577s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (f1222fd9-1ef9-4472-bd38-d280813391cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab63f27-998b-4d99-b6fd-1ec702173d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab63f27-998b-4d99-b6fd-1ec702173d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1349241751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7435c1c-806d-4698-91c4-230add308cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:54Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c29eca-28e4-4edb-9263-cbe5ecaf9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c29eca-28e4-4edb-9263-cbe5ecaf9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e43c1f4-a26f-4f91-88a4-c1f2b02abe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e43c1f4-a26f-4f91-88a4-c1f2b02abe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7435c1c-806d-4698-91c4-230add308cfa', 'volume_name': 'volume-f7435c1c-806d-4698-91c4-230add308cfa', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf2a087-8d64-44a8-9849-b739004b15c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf2a087-8d64-44a8-9849-b739004b15c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1cca0d-250a-4413-b611-b01ea9b3f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume f7435c1c-806d-4698-91c4-230add308cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7435c1c-806d-4698-91c4-230add308cfa', 'volume_size': 1} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:54 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 Jul 27 13:18:54 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:54 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1" returned: 0 in 0.280s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.244s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59715869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b21206f-0b75-4b31-b912-b44703ca7482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:53Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Creating volume 8b21206f-0b75-4b31-b912-b44703ca7482 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:54 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbf0cdc-0f5e-4c58-9955-99ce811ad156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56880fd-fbc8-4ee9-8c57-a972a9736bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 1073741824 Jul 27 13:18:54 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 (41e9d680-c4e0-4b07-8c80-dbdfac4b58c1): created successfully Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56880fd-fbc8-4ee9-8c57-a972a9736bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (aade08b1-b274-4f2a-a596-eb5531a6f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-16ad7fbe-a92f-4401-a6f6-1d23c1087c6e tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created volume successfully. Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (c69a8c79-5e02-4bf0-a2fd-f0b968eaa08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10461dca-31d5-4bb9-bc2a-d6f9eef82e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10461dca-31d5-4bb9-bc2a-d6f9eef82e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704111237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:55Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab678aa-5585-4210-b7fa-7e7da652e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab678aa-5585-4210-b7fa-7e7da652e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cef2d59-6250-4c4c-86fd-7f01db5f37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cef2d59-6250-4c4c-86fd-7f01db5f37fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7', 'volume_name': 'volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81beb046-16b9-4141-964b-3b8befb70613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:55 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81beb046-16b9-4141-964b-3b8befb70613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0accbbc-6765-46a0-8455-7d5a5c64b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Volume 95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7', 'volume_size': 1} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 1073741824" returned: 0 in 0.501s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:55 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 Jul 27 13:18:55 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:55 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304250223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e6ca5d-0c3b-477c-a86e-cf634bab837f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:54Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Creating volume 30e6ca5d-0c3b-477c-a86e-cf634bab837f {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:55 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf3f28d-149c-4fab-9f3f-a99965477ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b21206f-0b75-4b31-b912-b44703ca7482', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:55 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f 1073741824 Jul 27 13:18:55 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dfa499-a77d-4fef-82af-4ac04a5d51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume volume-8b21206f-0b75-4b31-b912-b44703ca7482 (8b21206f-0b75-4b31-b912-b44703ca7482): created successfully Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dfa499-a77d-4fef-82af-4ac04a5d51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (ecb92c9a-76eb-4c7a-9ccc-6e0228ef53fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-50ad8323-374c-4a9d-bd7c-3e6337fed2d2 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created volume successfully. Jul 27 13:18:55 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f 1073741824" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:55 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f Jul 27 13:18:55 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:56 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1349241751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7435c1c-806d-4698-91c4-230add308cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb0f8ad822248f0becea26e46b7c2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:54Z,use_quota=True,user_id='5da99612b66e47508931da763697e841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Creating volume f7435c1c-806d-4698-91c4-230add308cfa {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e645fbbd-dc3e-49b0-a47f-724e04e764f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:56 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa 1073741824 Jul 27 13:18:56 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6499d344-aa4a-483a-ba7b-a6fe4aca8a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f (30e6ca5d-0c3b-477c-a86e-cf634bab837f): created successfully Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6499d344-aa4a-483a-ba7b-a6fe4aca8a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (e4acb614-63e2-45c7-89ab-fe2a3e209ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5f33206d-d878-41b6-a9da-579e2b87a02f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created volume successfully. Jul 27 13:18:56 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa 1073741824" returned: 0 in 0.440s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:56 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa Jul 27 13:18:56 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:56 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa" returned: 0 in 0.254s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704111237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:18:55Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Creating volume 95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:18:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1cca0d-250a-4413-b611-b01ea9b3f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7435c1c-806d-4698-91c4-230add308cfa', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaccb680-538a-401c-8aab-affaecb82bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:56 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 1073741824 Jul 27 13:18:56 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Volume volume-f7435c1c-806d-4698-91c4-230add308cfa (f7435c1c-806d-4698-91c4-230add308cfa): created successfully Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaccb680-538a-401c-8aab-affaecb82bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Flow 'volume_create_manager' (f1222fd9-1ef9-4472-bd38-d280813391cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f02c7c0c-2cbd-44d3-ab59-a42010594cee tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created volume successfully. Jul 27 13:18:57 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 1073741824" returned: 0 in 0.407s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:57 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 Jul 27 13:18:57 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:57 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7" returned: 0 in 0.251s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0accbbc-6765-46a0-8455-7d5a5c64b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceec35d9-f2e0-4f59-9730-5da9af333afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:18:57 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Volume volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 (95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7): created successfully Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceec35d9-f2e0-4f59-9730-5da9af333afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (c69a8c79-5e02-4bf0-a2fd-f0b968eaa08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:18:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0f287352-5bf6-40f2-b2ad-d44427f7e4b1 tempest-VolumesActionsTest-1389628003 None] Created volume successfully. Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-f7435c1c-806d-4698-91c4-230add308cfa-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-f7435c1c-806d-4698-91c4-230add308cfa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-quobyte-f7435c1c-806d-4698-91c4-230add308cfa" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-f7435c1c-806d-4698-91c4-230add308cfa" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[64144868-5fd5-4027-9ee1-405c14176bed]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:57 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa Jul 27 13:18:57 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:58 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa" returned: 0 in 0.398s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:58 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa Jul 27 13:18:58 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Lock "cinder-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-quobyte-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c1428-78be-4b0a-bda9-dd2c2b711542]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:58 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f7435c1c-806d-4698-91c4-230add308cfa" returned: 0 in 0.309s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-f7435c1c-806d-4698-91c4-230add308cfa" released by "delete_volume" :: held 0.758s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:58 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 Jul 27 13:18:58 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created reservations ['480055c3-d041-427f-951c-99858893600a', '504ad7dd-ef17-49ee-9826-ef5abd3d27ca', '15480e12-f11e-4f05-b23b-311b00ead62e', '76f43736-76f5-40aa-ab74-618da32fb4ab'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:58 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:18:58 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:58 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7" returned: 0 in 0.488s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:58 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7 Jul 27 13:18:58 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-30e6ca5d-0c3b-477c-a86e-cf634bab837f-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-30e6ca5d-0c3b-477c-a86e-cf634bab837f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:58 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.426s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:18:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Deleted volume successfully. Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-quobyte-30e6ca5d-0c3b-477c-a86e-cf634bab837f" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-30e6ca5d-0c3b-477c-a86e-cf634bab837f" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78f7a130-d757-44d4-bea9-107ffcf77536 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-f7435c1c-806d-4698-91c4-230add308cfa-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4a6a67-41ca-4eb3-8b96-7eb5e52a282c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:59 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f Jul 27 13:18:59 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:59 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7" returned: 0 in 0.478s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7" released by "delete_volume" :: held 1.017s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Created reservations ['26d39417-b6cf-474a-9b20-19dc7c45cc55', '40c43bb3-054f-45fb-a0ec-98283f8c5324', 'a9dd6e3e-7f1d-4556-bcb9-87f6e56afa80', 'c50fc8e6-ba87-4491-ba93-4ecf0e1c2a6c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:59 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:18:59 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:59 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f" returned: 0 in 0.553s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:18:59 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f Jul 27 13:18:59 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:18:59 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.291s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:18:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Deleted volume successfully. Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8d04a825-b00f-4bc2-8c09-28d55fe2451f tempest-VolumesActionsTest-3137151 None] Lock "cinder-95e8324a-ed6c-4eda-93f1-8e0c5bb55ce7-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:18:59 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-30e6ca5d-0c3b-477c-a86e-cf634bab837f" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:18:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-30e6ca5d-0c3b-477c-a86e-cf634bab837f" released by "delete_volume" :: held 0.874s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created reservations ['87e2f283-6e64-4a60-9956-b668bb28a844', 'fc653c67-2892-4608-9a09-ef5f7b63c7a9', '4b882534-c20e-45f6-80c9-716ff3048949', 'f249afdf-26b3-4b9a-acc6-2dab4c11984c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:00 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:00 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-8b21206f-0b75-4b31-b912-b44703ca7482-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-8b21206f-0b75-4b31-b912-b44703ca7482-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-quobyte-8b21206f-0b75-4b31-b912-b44703ca7482" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-8b21206f-0b75-4b31-b912-b44703ca7482" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f05ce-fc64-4ca2-9d9a-7080f91028f3]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:00 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Deleted volume successfully. Jul 27 13:19:00 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 Jul 27 13:19:00 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22a56012-e73b-44c1-8790-ad2554481aa5 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-30e6ca5d-0c3b-477c-a86e-cf634bab837f-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:00 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:00 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482 Jul 27 13:19:00 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:00 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b21206f-0b75-4b31-b912-b44703ca7482" returned: 0 in 0.280s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-8b21206f-0b75-4b31-b912-b44703ca7482" released by "delete_volume" :: held 0.729s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created reservations ['748b4c6d-d911-4824-b2b2-e4ac26e8bb87', '065aac60-33cf-4b83-b1eb-3b27bff3ce54', '70cc412a-0152-4672-aa37-c85437e61414', '6d72c37f-6af9-42ab-a09a-17c86516184b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:01 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:01 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (9da9bbda-4337-4542-968b-8c705aec4b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab568b18-b4ce-45c3-a1de-dde966904ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab568b18-b4ce-45c3-a1de-dde966904ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779070763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243460f0-14a0-4f02-921b-07ef00f933ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:01Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc237235-41ec-4370-9145-703a45134eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc237235-41ec-4370-9145-703a45134eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3b359d-9275-447f-bdd2-d10fd106ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3b359d-9275-447f-bdd2-d10fd106ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243460f0-14a0-4f02-921b-07ef00f933ac', 'volume_name': 'volume-243460f0-14a0-4f02-921b-07ef00f933ac', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f8388f-ea22-42e8-8cee-1166e17704c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f8388f-ea22-42e8-8cee-1166e17704c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208cdf84-8b8a-46e2-a82f-7b57761623cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:01 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Volume 243460f0-14a0-4f02-921b-07ef00f933ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243460f0-14a0-4f02-921b-07ef00f933ac', 'volume_size': 1} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779070763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243460f0-14a0-4f02-921b-07ef00f933ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:01Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Creating volume 243460f0-14a0-4f02-921b-07ef00f933ac {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:01 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:01 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac 1073741824 Jul 27 13:19:01 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:01 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.303s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-quobyte-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Deleted volume successfully. Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c7a87a0-bfe2-4326-a196-23b88244202f tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-8b21206f-0b75-4b31-b912-b44703ca7482-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2086bf2-7ac7-4839-87f3-b562f93dda1f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:01 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 Jul 27 13:19:01 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:01 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac 1073741824" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:01 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac Jul 27 13:19:01 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:01 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1" returned: 0 in 0.373s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:01 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1 Jul 27 13:19:01 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:01 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208cdf84-8b8a-46e2-a82f-7b57761623cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243460f0-14a0-4f02-921b-07ef00f933ac', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec08ed5e-1acc-4ab6-9ef8-f0780d320e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:02 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Volume volume-243460f0-14a0-4f02-921b-07ef00f933ac (243460f0-14a0-4f02-921b-07ef00f933ac): created successfully Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec08ed5e-1acc-4ab6-9ef8-f0780d320e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (9da9bbda-4337-4542-968b-8c705aec4b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:02 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7fdb7a61-b2d4-470e-8fb3-283715ec9e37 tempest-VolumesActionsTest-1389628003 None] Created volume successfully. Jul 27 13:19:02 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1" returned: 0 in 0.270s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1" released by "delete_volume" :: held 0.692s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created reservations ['0a096146-04a9-4a85-aa62-db38d63b7090', '526d492a-b385-4f70-a2bb-0c1895781867', '7659caba-0c9f-403a-b39f-35d7f2bcb0e1', '71ef61c4-2629-40af-ba76-33c9567b1449'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:02 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:02 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:02 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-54936bfe-4eea-4ce2-9e3f-21a10f74137a-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:02 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Deleted volume successfully. Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-54936bfe-4eea-4ce2-9e3f-21a10f74137a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a3a1ad09-3e92-43ae-9a46-bba5d688b09a tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-41e9d680-c4e0-4b07-8c80-dbdfac4b58c1-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-quobyte-54936bfe-4eea-4ce2-9e3f-21a10f74137a" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-54936bfe-4eea-4ce2-9e3f-21a10f74137a" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5444511e-685c-41e2-b805-287d558fd518]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:02 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a Jul 27 13:19:02 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Flow 'volume_create_manager' (a44a17db-446d-4a1b-8152-1afd5bfc3354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f66e1ac-eaf0-479c-adda-e74c9c925100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f66e1ac-eaf0-479c-adda-e74c9c925100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-636190312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66553a7-932a-41f9-9f44-f845e516e924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270595c216764c6aabd454783948237c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:03Z,use_quota=True,user_id='2d464e3c1ee04a7ab75cb7fcb7993bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7620f6d4-662b-4807-ad8f-ee8e0d601d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7620f6d4-662b-4807-ad8f-ee8e0d601d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdaa418-1e0f-4306-bf8b-7475bdbef2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdaa418-1e0f-4306-bf8b-7475bdbef2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66553a7-932a-41f9-9f44-f845e516e924', 'volume_name': 'volume-c66553a7-932a-41f9-9f44-f845e516e924', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e90ef9a-3766-4661-9d46-d18745733791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e90ef9a-3766-4661-9d46-d18745733791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2ef23a-d89f-41e2-bcac-7067d4858f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:02 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Volume c66553a7-932a-41f9-9f44-f845e516e924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66553a7-932a-41f9-9f44-f845e516e924', 'volume_size': 1} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-636190312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66553a7-932a-41f9-9f44-f845e516e924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270595c216764c6aabd454783948237c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:03Z,use_quota=True,user_id='2d464e3c1ee04a7ab75cb7fcb7993bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Creating volume c66553a7-932a-41f9-9f44-f845e516e924 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:02 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:02 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 1073741824 Jul 27 13:19:02 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:02 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a" returned: 0 in 0.373s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:03 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a Jul 27 13:19:03 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:03 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54936bfe-4eea-4ce2-9e3f-21a10f74137a" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-54936bfe-4eea-4ce2-9e3f-21a10f74137a" released by "delete_volume" :: held 0.685s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:03 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 1073741824" returned: 0 in 0.480s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created reservations ['52d0cc0d-ad29-420d-a874-17948ca6ba71', '45098ee3-cf83-47d3-8d47-fbeb2748f3ed', '25b78304-fec5-4e86-a3eb-20c5d9eb5e56', '32004b2d-a369-48a0-bdd2-a9aa0fbc88ae'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-243460f0-14a0-4f02-921b-07ef00f933ac-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:03 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 Jul 27 13:19:03 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Lock "cinder-243460f0-14a0-4f02-921b-07ef00f933ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:03 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:03 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-quobyte-243460f0-14a0-4f02-921b-07ef00f933ac" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-243460f0-14a0-4f02-921b-07ef00f933ac" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99d9ba6-6a4c-4fc0-998b-34b8c5a31fb8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:03 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924" returned: 0 in 0.289s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2ef23a-d89f-41e2-bcac-7067d4858f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66553a7-932a-41f9-9f44-f845e516e924', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b04d53-9f07-4884-bc3a-78963104e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:03 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac Jul 27 13:19:03 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Volume volume-c66553a7-932a-41f9-9f44-f845e516e924 (c66553a7-932a-41f9-9f44-f845e516e924): created successfully Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b04d53-9f07-4884-bc3a-78963104e884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Flow 'volume_create_manager' (a44a17db-446d-4a1b-8152-1afd5bfc3354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-dcb63939-662d-4742-961b-565fcc8777ea tempest-AttachVolumeNegativeTest-1681737704 None] Created volume successfully. Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:03 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.310s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Deleted volume successfully. Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "cinder-quobyte-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fab10c33-0909-4a9e-a7da-78de5ad7a182 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-54936bfe-4eea-4ce2-9e3f-21a10f74137a-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[acffbdea-ab77-451d-8b60-8bb67ca18289]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:03 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 Jul 27 13:19:03 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:03 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:04 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac Jul 27 13:19:04 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:04 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:04 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-243460f0-14a0-4f02-921b-07ef00f933ac" returned: 0 in 0.253s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:04 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505 Jul 27 13:19:04 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-243460f0-14a0-4f02-921b-07ef00f933ac" released by "delete_volume" :: held 0.727s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Created reservations ['18e6bb8a-56b5-405d-84b4-35d77e9304d1', 'f50b240a-c30b-47dc-ba0e-2f071f4abbfd', '1749ebe9-f2bd-4456-8d15-9e2300140177', '194334f6-735d-47d3-8778-3f27d8d096ae'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:04 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:04 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:04 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-quobyte-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505" released by "delete_volume" :: held 0.659s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Created reservations ['17df85e7-033b-4825-b4b2-63f1db2df027', '50e271d4-cfd3-4294-b065-5786c615b163', '464e1f49-2870-42d2-8844-2785a566d060', '363767e7-0fa9-4137-b635-0a8a05e7e777'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:04 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:04 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:04 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.279s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Deleted volume successfully. Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ec1b531-4638-4ba1-9ddb-1909c81d6e86 tempest-VolumesActionsTest-3137151 None] Lock "cinder-243460f0-14a0-4f02-921b-07ef00f933ac-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:04 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.336s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:04 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Deleted volume successfully. Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22fb8bb5-159a-4375-af6c-3d02bb726395 tempest-CreateVolumesFromSourceVolumeTest-1305916821 None] Lock "cinder-0e14a52c-a7c9-41ed-9cfe-0bc3d12e0505-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (97410f56-1ce7-45de-aef1-bcd207ee68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba08f411-43cf-4d90-90ec-184c79f03388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba08f411-43cf-4d90-90ec-184c79f03388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2078112948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b03a4b-ded6-4017-862f-a2eca37cb7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:05Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734275a5-004b-4826-b3f6-4ed64110737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734275a5-004b-4826-b3f6-4ed64110737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c14593-a8f0-430b-a0bf-c4d2bb5ec861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c14593-a8f0-430b-a0bf-c4d2bb5ec861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b03a4b-ded6-4017-862f-a2eca37cb7b4', 'volume_name': 'volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b94e55-9f25-4c37-b5c0-30d09350d927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b94e55-9f25-4c37-b5c0-30d09350d927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7855ce-200b-4495-959e-e4060bd17af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Volume 24b03a4b-ded6-4017-862f-a2eca37cb7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4', 'volume_size': 1} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2078112948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b03a4b-ded6-4017-862f-a2eca37cb7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:05Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Creating volume 24b03a4b-ded6-4017-862f-a2eca37cb7b4 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:05 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:05 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 1073741824 Jul 27 13:19:05 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-8c1f14e2-1064-463c-8fdf-231b6bde27cc req-d5604c81-6b2f-44bd-a1f8-7c41e5c8a53c tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:05 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 1073741824" returned: 0 in 0.560s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:06 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 Jul 27 13:19:06 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:06 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4" returned: 0 in 0.270s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-8c1f14e2-1064-463c-8fdf-231b6bde27cc req-d5604c81-6b2f-44bd-a1f8-7c41e5c8a53c tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.501s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7855ce-200b-4495-959e-e4060bd17af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01aa585-d751-48b4-b156-b3905f0c3234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-8c1f14e2-1064-463c-8fdf-231b6bde27cc req-d5604c81-6b2f-44bd-a1f8-7c41e5c8a53c tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:06 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Volume volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 (24b03a4b-ded6-4017-862f-a2eca37cb7b4): created successfully Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01aa585-d751-48b4-b156-b3905f0c3234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (97410f56-1ce7-45de-aef1-bcd207ee68c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5875ea77-acd0-4e85-9a95-eeb7a7870a35 tempest-VolumesActionsTest-1389628003 None] Created volume successfully. Jul 27 13:19:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-8c1f14e2-1064-463c-8fdf-231b6bde27cc req-d5604c81-6b2f-44bd-a1f8-7c41e5c8a53c tempest-AttachVolumeNegativeTest-1681737704 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-c66553a7-932a-41f9-9f44-f845e516e924', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d3f8e0e-4d33-4a4e-a0a0-1c5832e7ea38', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:19:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-8c1f14e2-1064-463c-8fdf-231b6bde27cc req-d5604c81-6b2f-44bd-a1f8-7c41e5c8a53c tempest-AttachVolumeNegativeTest-1681737704 None] attachment_update completed successfully. Jul 27 13:19:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-24b03a4b-ded6-4017-862f-a2eca37cb7b4-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Lock "cinder-24b03a4b-ded6-4017-862f-a2eca37cb7b4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-quobyte-24b03a4b-ded6-4017-862f-a2eca37cb7b4" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-24b03a4b-ded6-4017-862f-a2eca37cb7b4" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8646f25b-f68c-41c8-808d-02cdc5a6ea1d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:07 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 Jul 27 13:19:07 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:08 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4" returned: 0 in 0.458s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:08 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4 Jul 27 13:19:08 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:08 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-24b03a4b-ded6-4017-862f-a2eca37cb7b4" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-24b03a4b-ded6-4017-862f-a2eca37cb7b4" released by "delete_volume" :: held 0.922s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Created reservations ['1077dba7-8cf7-4d85-9726-1fa5984111e2', '0840a970-92ec-487a-9cff-4631616417d5', 'df696813-6a52-41f9-8c00-842776b0b7ff', '3f58b8ac-8d7d-45e6-9fe3-13f5a9f32547'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Flow 'volume_create_manager' (43816a44-4371-4335-88d2-122038498f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a7c11c-9a55-45b4-acbe-0c5741fc51f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a7c11c-9a55-45b4-acbe-0c5741fc51f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2106570879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1d517-aeca-4141-8b0a-e25ba2c78a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0998534e031e491aafa1459223f58c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:09Z,use_quota=True,user_id='c1efd1c148a04f7685777140153b9e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1054fd80-caf9-43ae-93f7-a8d94c25d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1054fd80-caf9-43ae-93f7-a8d94c25d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c1638d-b5c5-4705-9201-7f0011edfe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c1638d-b5c5-4705-9201-7f0011edfe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc1d517-aeca-4141-8b0a-e25ba2c78a8a', 'volume_name': 'volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3265b261-a89c-4d94-8606-b923278fe08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3265b261-a89c-4d94-8606-b923278fe08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea0d6e3-222b-45d3-a91e-86d6bf3d8c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Volume 2bc1d517-aeca-4141-8b0a-e25ba2c78a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a', 'volume_size': 1} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2106570879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1d517-aeca-4141-8b0a-e25ba2c78a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0998534e031e491aafa1459223f58c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:09Z,use_quota=True,user_id='c1efd1c148a04f7685777140153b9e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Creating volume 2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:08 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:08 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a 1073741824 Jul 27 13:19:08 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:08 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:08 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-ca3c5625-29ce-4b8e-966e-41a67ce627d3 req-24954cfe-e9b7-44fd-a2db-3b2dc47445f5 tempest-AttachVolumeNegativeTest-1681737704 None] Terminate volume connection completed successfully. Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-ca3c5625-29ce-4b8e-966e-41a67ce627d3 req-24954cfe-e9b7-44fd-a2db-3b2dc47445f5 tempest-AttachVolumeNegativeTest-1681737704 None] Deleting attachment 8d3f8e0e-4d33-4a4e-a0a0-1c5832e7ea38. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:19:09 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Deleted volume successfully. Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-021c87da-ec89-421f-bd42-7259aefbed71 tempest-VolumesActionsTest-3137151 None] Lock "cinder-24b03a4b-ded6-4017-862f-a2eca37cb7b4-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (86895066-1f47-49cd-8215-f47c7bd6a877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e76fed-065f-430b-951b-6caac1f60bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e76fed-065f-430b-951b-6caac1f60bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519497320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfe896c-1806-40ea-a924-4dca6b5a0647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:09Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c7d563-a2c6-42a0-9aa7-5fc6a1841b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c7d563-a2c6-42a0-9aa7-5fc6a1841b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:09 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e39c072-d679-4bc6-8a43-b992970ac0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e39c072-d679-4bc6-8a43-b992970ac0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dfe896c-1806-40ea-a924-4dca6b5a0647', 'volume_name': 'volume-2dfe896c-1806-40ea-a924-4dca6b5a0647', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f07843-5b1a-4545-ac3e-02c40f7f5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f07843-5b1a-4545-ac3e-02c40f7f5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2447fc60-746f-45eb-8e9c-d67a08b671b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:09 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Volume 2dfe896c-1806-40ea-a924-4dca6b5a0647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dfe896c-1806-40ea-a924-4dca6b5a0647', 'volume_size': 1} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a 1073741824" returned: 0 in 0.652s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:09 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:09 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:09 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.360s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519497320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfe896c-1806-40ea-a924-4dca6b5a0647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:09Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Creating volume 2dfe896c-1806-40ea-a924-4dca6b5a0647 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:09 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea0d6e3-222b-45d3-a91e-86d6bf3d8c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:09 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 1073741824 Jul 27 13:19:09 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843a50e9-1023-48eb-b852-0d58119ac369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Flow 'volume_create_manager' (bca42774-c282-4fc3-943b-24bff45b21a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907fa407-e424-4738-a20c-fb6da7fb4d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Volume volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a (2bc1d517-aeca-4141-8b0a-e25ba2c78a8a): created successfully Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843a50e9-1023-48eb-b852-0d58119ac369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Flow 'volume_create_manager' (43816a44-4371-4335-88d2-122038498f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907fa407-e424-4738-a20c-fb6da7fb4d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-646955874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d1802c-7c6b-430b-a196-4870c2f5b612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3485d65ed4c941a69aca8dbeb62c9411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:10Z,use_quota=True,user_id='7f9542b0ea384867a2380724703c6427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f90e67-7662-4486-9e7a-a33f7b7cefb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f90e67-7662-4486-9e7a-a33f7b7cefb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b5b256-2e70-4c1d-86b9-84a056d2bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b5b256-2e70-4c1d-86b9-84a056d2bb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d1802c-7c6b-430b-a196-4870c2f5b612', 'volume_name': 'volume-55d1802c-7c6b-430b-a196-4870c2f5b612', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f63c45-f53a-44a3-9c08-efc36d110e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f63c45-f53a-44a3-9c08-efc36d110e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf42e0-bafd-4389-a7b2-b1cf0940ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Volume 55d1802c-7c6b-430b-a196-4870c2f5b612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d1802c-7c6b-430b-a196-4870c2f5b612', 'volume_size': 1} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f3a7fcd3-ba7f-4a11-a5df-45811ce4d5f1 tempest-VolumeDependencyTests-534484580 None] Created volume successfully. Jul 27 13:19:10 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 1073741824" returned: 0 in 0.616s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:10 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 Jul 27 13:19:10 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:10 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647" returned: 0 in 0.366s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-646955874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d1802c-7c6b-430b-a196-4870c2f5b612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3485d65ed4c941a69aca8dbeb62c9411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:10Z,use_quota=True,user_id='7f9542b0ea384867a2380724703c6427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Creating volume 55d1802c-7c6b-430b-a196-4870c2f5b612 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:11 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:11 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 1073741824 Jul 27 13:19:11 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2447fc60-746f-45eb-8e9c-d67a08b671b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfe896c-1806-40ea-a924-4dca6b5a0647', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15884b28-37e1-41c6-94fd-e6de0e9ff79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:11 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Volume volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 (2dfe896c-1806-40ea-a924-4dca6b5a0647): created successfully Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15884b28-37e1-41c6-94fd-e6de0e9ff79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (86895066-1f47-49cd-8215-f47c7bd6a877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-201389d3-175d-453d-ac46-2bdc17b198cf tempest-VolumesActionsTest-1389628003 None] Created volume successfully. Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:11 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 1073741824" returned: 0 in 0.703s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:11 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 Jul 27 13:19:11 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-2dfe896c-1806-40ea-a924-4dca6b5a0647-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Lock "cinder-2dfe896c-1806-40ea-a924-4dca6b5a0647-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Acquiring lock "cinder-quobyte-2dfe896c-1806-40ea-a924-4dca6b5a0647" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-2dfe896c-1806-40ea-a924-4dca6b5a0647" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0443f25-41f9-436d-80a6-899724145df8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:12 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612" returned: 0 in 0.304s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.857s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:12 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 Jul 27 13:19:12 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf42e0-bafd-4389-a7b2-b1cf0940ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d1802c-7c6b-430b-a196-4870c2f5b612', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac02642-03c6-4f0a-8fa8-592b9cbb93bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:12 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Volume volume-55d1802c-7c6b-430b-a196-4870c2f5b612 (55d1802c-7c6b-430b-a196-4870c2f5b612): created successfully Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac02642-03c6-4f0a-8fa8-592b9cbb93bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Flow 'volume_create_manager' (bca42774-c282-4fc3-943b-24bff45b21a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Creating offline snapshot a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 of volume 2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:19:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-103115ea-2045-4b0a-884b-0f49c0fe9b0c tempest-AttachVolumeTestJSON-570659394 None] Created volume successfully. Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ce2ffd-f6a9-4b28-a7bb-aab6fcce60c6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:12 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:12 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:12 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647" returned: 0 in 0.449s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:12 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647 Jul 27 13:19:12 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:12 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.409s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:12 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 1G Jul 27 13:19:12 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:12 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2dfe896c-1806-40ea-a924-4dca6b5a0647" returned: 0 in 0.280s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Lock "cinder-quobyte-2dfe896c-1806-40ea-a924-4dca6b5a0647" released by "delete_volume" :: held 0.775s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Created reservations ['7ce34ec5-f735-4d3a-8b81-fa03e63b47fa', '6f90b24b-4fe0-4791-b7dc-8e73567994b0', '1dfc5b16-f166-4988-ba9d-83693ba90af5', 'c1064075-1a77-4277-98e4-1efc79e7dba7'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:12 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:12 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:13 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 1G" returned: 0 in 0.441s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:13 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Deleted volume successfully. Jul 27 13:19:13 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 Jul 27 13:19:13 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc9e93e2-e6b2-41f5-81a3-6a69c1fa952e tempest-VolumesActionsTest-3137151 None] Lock "cinder-2dfe896c-1806-40ea-a924-4dca6b5a0647-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:13 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:13 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 is being set with open permissions: ugo+rw Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:13 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 Jul 27 13:19:13 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (cfc24ac4-727b-400f-bca1-e58aeee21498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cf2fe1-b3da-4994-ba36-87cb67cc98fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cf2fe1-b3da-4994-ba36-87cb67cc98fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-42686669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71cd3462-cb4f-440e-b316-aa71e62acb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:14Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb1beb6-e608-4d71-900b-cd3968a8b79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb1beb6-e608-4d71-900b-cd3968a8b79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25574178-d2b9-453a-9a8f-430e79b2d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25574178-d2b9-453a-9a8f-430e79b2d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71cd3462-cb4f-440e-b316-aa71e62acb97', 'volume_name': 'volume-71cd3462-cb4f-440e-b316-aa71e62acb97', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ea53f1-05c3-4c91-93da-73811f8d3083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ea53f1-05c3-4c91-93da-73811f8d3083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41265d9e-d56d-4286-8ef2-3b34fc65ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:13 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Volume 71cd3462-cb4f-440e-b316-aa71e62acb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71cd3462-cb4f-440e-b316-aa71e62acb97', 'volume_size': 1} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:13 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" returned: 0 in 0.329s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:13 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info Jul 27 13:19:13 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:14 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info" returned: 0 in 0.325s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:14 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info is being set with open permissions: ugo+rw Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:14 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info Jul 27 13:19:14 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-493b6393-d829-4ae0-8754-0a4e87f310e0 req-f8de1c8b-867c-43f4-ab3b-0b282f46a66d tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:14 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.info" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-42686669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71cd3462-cb4f-440e-b316-aa71e62acb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f8ba1aedf1449aa95187e85de33f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:14Z,use_quota=True,user_id='02d7595036ec44a9bb4e18838170342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Creating volume 71cd3462-cb4f-440e-b316-aa71e62acb97 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:14 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:14 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 1073741824 Jul 27 13:19:14 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-74c3c385-4c3a-4991-9749-95c8e7a3a41f tempest-VolumeDependencyTests-534484580 None] Create snapshot completed successfully Jul 27 13:19:14 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 1073741824" returned: 0 in 0.467s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:14 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 Jul 27 13:19:14 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:15 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97" returned: 0 in 0.272s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-493b6393-d829-4ae0-8754-0a4e87f310e0 req-f8de1c8b-867c-43f4-ab3b-0b282f46a66d tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.889s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41265d9e-d56d-4286-8ef2-3b34fc65ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71cd3462-cb4f-440e-b316-aa71e62acb97', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacfed95-5a24-43b8-bf6a-78459c5833f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-493b6393-d829-4ae0-8754-0a4e87f310e0 req-f8de1c8b-867c-43f4-ab3b-0b282f46a66d tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:15 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Volume volume-71cd3462-cb4f-440e-b316-aa71e62acb97 (71cd3462-cb4f-440e-b316-aa71e62acb97): created successfully Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacfed95-5a24-43b8-bf6a-78459c5833f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Flow 'volume_create_manager' (cfc24ac4-727b-400f-bca1-e58aeee21498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2167002d-f4e1-466d-a2a1-205765483d03 tempest-VolumesActionsTest-1389628003 None] Created volume successfully. Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-493b6393-d829-4ae0-8754-0a4e87f310e0 req-f8de1c8b-867c-43f4-ab3b-0b282f46a66d tempest-AttachVolumeTestJSON-570659394 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-55d1802c-7c6b-430b-a196-4870c2f5b612', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50ebf807-7174-41b8-b308-ed72ee38c686', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:19:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-493b6393-d829-4ae0-8754-0a4e87f310e0 req-f8de1c8b-867c-43f4-ab3b-0b282f46a66d tempest-AttachVolumeTestJSON-570659394 None] attachment_update completed successfully. Jul 27 13:19:15 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Flow 'volume_create_manager' (ac2b1977-1a84-4da0-9a21-9ac76e565c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a9fb8e-8b85-4713-acd7-98bf8012e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a9fb8e-8b85-4713-acd7-98bf8012e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1460104779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5be1c2-e36f-422e-87d8-15f870ae4887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0998534e031e491aafa1459223f58c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:16Z,use_quota=True,user_id='c1efd1c148a04f7685777140153b9e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123f4ad6-2a64-4a4a-ba13-5fe7c1b8ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123f4ad6-2a64-4a4a-ba13-5fe7c1b8ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91ae794-3033-40af-993f-c2bc8a23f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91ae794-3033-40af-993f-c2bc8a23f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c5be1c2-e36f-422e-87d8-15f870ae4887', 'volume_name': 'volume-4c5be1c2-e36f-422e-87d8-15f870ae4887', 'volume_size': 1, 'snapshot_id': 'a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99a0e06-1b33-4d5d-8ddc-015a591e6dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99a0e06-1b33-4d5d-8ddc-015a591e6dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50708fbc-4460-43b9-8955-b0e4cb9498f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:16 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Volume 4c5be1c2-e36f-422e-87d8-15f870ae4887: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c5be1c2-e36f-422e-87d8-15f870ae4887', 'volume_size': 1, 'snapshot_id': 'a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8'} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-quobyte-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8-4c5be1c2-e36f-422e-87d8-15f870ae4887" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8-4c5be1c2-e36f-422e-87d8-15f870ae4887" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Creating volume 4c5be1c2-e36f-422e-87d8-15f870ae4887 from snapshot a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-quobyte-4c5be1c2-e36f-422e-87d8-15f870ae4887" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-4c5be1c2-e36f-422e-87d8-15f870ae4887" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] snapshot: a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8, volume: 4c5be1c2-e36f-422e-87d8-15f870ae4887, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7150d1f3-2707-4e06-8843-1bfa7797f870]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:16 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 Jul 27 13:19:16 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "cinder-71cd3462-cb4f-440e-b316-aa71e62acb97-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Lock "cinder-71cd3462-cb4f-440e-b316-aa71e62acb97-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "cinder-quobyte-71cd3462-cb4f-440e-b316-aa71e62acb97" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Lock "cinder-quobyte-71cd3462-cb4f-440e-b316-aa71e62acb97" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92cb03-a6bd-4af2-beef-4d0c002ededa]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:16 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" returned: 0 in 0.539s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71a5fde-028c-4d7c-8109-65cac7c3db91]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:16 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 Jul 27 13:19:16 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:16 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:16 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:17 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97" returned: 0 in 0.451s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:17 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97 Jul 27 13:19:17 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:17 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.452s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:17 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 Jul 27 13:19:17 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:17 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71cd3462-cb4f-440e-b316-aa71e62acb97" returned: 0 in 0.354s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Lock "cinder-quobyte-71cd3462-cb4f-440e-b316-aa71e62acb97" released by "delete_volume" :: held 0.878s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Created reservations ['933c18d4-558c-4a7f-89e3-e64539d319d8', 'b2e6c5f5-4c80-4db5-a291-c1cbf4c10923', '219a0356-9882-4960-b848-28047341fe13', 'db109268-f5bf-4e97-bc02-92790633ab81'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:17 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:17 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:18 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.314s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:18 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Deleted volume successfully. Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb027065-05cf-4cbd-8b13-9e2377ebc033 tempest-VolumesActionsTest-1389628003 None] Lock "cinder-71cd3462-cb4f-440e-b316-aa71e62acb97-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Flow 'volume_create_manager' (90e67e96-6850-41a2-894f-730b7debd172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa2b2b8-4eed-4911-afd5-a06e59863571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa2b2b8-4eed-4911-afd5-a06e59863571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1779842741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbad5b89-9fe8-4257-9684-95b2f62ed3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3485d65ed4c941a69aca8dbeb62c9411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:19Z,use_quota=True,user_id='7f9542b0ea384867a2380724703c6427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1672513c-8048-4aa9-ba6f-1a759972e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1672513c-8048-4aa9-ba6f-1a759972e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0d6d88-b598-4292-b552-055af49c5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0d6d88-b598-4292-b552-055af49c5023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbad5b89-9fe8-4257-9684-95b2f62ed3d7', 'volume_name': 'volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486e92d3-dcd0-47db-83cf-4b088934f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486e92d3-dcd0-47db-83cf-4b088934f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9fc956-da26-4d46-93ff-3383ca60e36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:19 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Volume bbad5b89-9fe8-4257-9684-95b2f62ed3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7', 'volume_size': 1} Jul 27 13:19:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:23 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887" returned: 0 in 6.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ccf6a0-5d55-451d-aa02-99a1094de61d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:23 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:23 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:24 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.620s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:19:24 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Converted 1024.00 MB image at 163.60 MB/s Jul 27 13:19:24 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 is being set with open permissions: ugo+rw Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:24 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 Jul 27 13:19:24 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:24 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887" returned: 0 in 0.317s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-4c5be1c2-e36f-422e-87d8-15f870ae4887" released by "_copy_volume_from_snapshot" :: held 8.367s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8-4c5be1c2-e36f-422e-87d8-15f870ae4887" released by "_create_volume_from_snapshot" :: held 8.412s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.430s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.441s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1779842741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbad5b89-9fe8-4257-9684-95b2f62ed3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3485d65ed4c941a69aca8dbeb62c9411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:19Z,use_quota=True,user_id='7f9542b0ea384867a2380724703c6427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Creating volume bbad5b89-9fe8-4257-9684-95b2f62ed3d7 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:24 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=139,cinder:UPDATE=164,cinder:INSERT=43,cinder:DELETE=13 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:INSERT=38,cinder:SELECT=125,cinder:UPDATE=163,cinder:DELETE=17 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:19:24 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 1073741824 Jul 27 13:19:24 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50708fbc-4460-43b9-8955-b0e4cb9498f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5be1c2-e36f-422e-87d8-15f870ae4887', 'volume_size': 1, 'snapshot_id': 'a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4ce013-b316-4dbd-bcd0-973d874b5f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Volume volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 (4c5be1c2-e36f-422e-87d8-15f870ae4887): created successfully Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4ce013-b316-4dbd-bcd0-973d874b5f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Flow 'volume_create_manager' (ac2b1977-1a84-4da0-9a21-9ac76e565c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5d525c0f-05df-4bd4-8c34-433e350cc957 tempest-VolumeDependencyTests-534484580 None] Created volume successfully. Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Lock "cinder-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-quobyte-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-quobyte-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Deleting offline snapshot a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 of volume 2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] snapshot_file for this snap is: volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b1503-a91d-499c-9448-ae15b8d3dd60]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:25 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 1073741824" returned: 0 in 0.760s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:25 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 Jul 27 13:19:25 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:25 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 Jul 27 13:19:25 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:25 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7" returned: 0 in 0.323s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9fc956-da26-4d46-93ff-3383ca60e36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d3db3e-1f5d-42eb-8572-06b27d973d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Volume volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 (bbad5b89-9fe8-4257-9684-95b2f62ed3d7): created successfully Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d3db3e-1f5d-42eb-8572-06b27d973d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:25 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Flow 'volume_create_manager' (90e67e96-6850-41a2-894f-730b7debd172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" returned: 0 in 0.503s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:19:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1e0e690b-a40d-4ad7-a089-a21ae3423879 tempest-AttachVolumeTestJSON-570659394 None] Created volume successfully. Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f24fb-8999-4826-883f-e93f656f7184]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:26 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:26 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:26 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.841s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:26 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 Jul 27 13:19:26 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:27 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" returned: 0 in 0.790s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:27 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8 Jul 27 13:19:27 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc85d973-a1c9-48b6-b76f-e21b4ea9ecf3 req-facd9913-0462-4a8f-ab03-ad76eecd4749 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc85d973-a1c9-48b6-b76f-e21b4ea9ecf3 req-facd9913-0462-4a8f-ab03-ad76eecd4749 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc85d973-a1c9-48b6-b76f-e21b4ea9ecf3 req-facd9913-0462-4a8f-ab03-ad76eecd4749 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-bc85d973-a1c9-48b6-b76f-e21b4ea9ecf3 req-facd9913-0462-4a8f-ab03-ad76eecd4749 tempest-AttachVolumeTestJSON-570659394 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e87bef06-85e4-44fd-94bf-1b30263848dc', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:19:28 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a.a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" returned: 0 in 0.562s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-bc85d973-a1c9-48b6-b76f-e21b4ea9ecf3 req-facd9913-0462-4a8f-ab03-ad76eecd4749 tempest-AttachVolumeTestJSON-570659394 None] attachment_update completed successfully. Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8" released by "_delete_snapshot" :: held 2.887s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" released by "delete_snapshot" :: held 2.925s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Created reservations ['26ff4675-7edd-4f90-b1cb-1959482e5722', 'c2736f1a-c69f-49ee-a27c-6d31237dcb48', '0933727a-2b1c-4227-999f-fbc81ae6d6b0', 'ba5866b3-b4fb-491b-8938-6b214f91d042'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Delete snapshot completed successfully. Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a56dbefd-d0e4-44bb-9de8-73b945455fbb tempest-VolumeDependencyTests-534484580 None] Lock "cinder-a24e3d62-b5e5-4e8f-a6cb-c57e85fcffd8-delete_snapshot" released by "delete_snapshot" :: held 3.227s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-quobyte-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" acquired by "delete_volume" :: waited 0.041s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45ff28-cf50-4e06-a898-e866390efe59]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:29 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:29 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:29 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.962s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:29 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a Jul 27 13:19:29 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:30 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" returned: 0 in 0.412s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a" released by "delete_volume" :: held 1.516s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Created reservations ['0ecadc05-02b0-45bf-b255-b516ad9f5c9e', '4845e967-c9ff-4a06-be5b-49fe5aea8a25', 'd9a3a24c-f49e-46d9-835c-7e1a3878ef2e', '5f190c9e-0442-4298-8db0-76b42e61ca57'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:30 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:30 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:30 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.371s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Deleted volume successfully. Jul 27 13:19:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7e59b0a8-2424-4208-9dd2-745871e317e2 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-2bc1d517-aeca-4141-8b0a-e25ba2c78a8a-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-4c5be1c2-e36f-422e-87d8-15f870ae4887-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-4c5be1c2-e36f-422e-87d8-15f870ae4887-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "cinder-quobyte-4c5be1c2-e36f-422e-87d8-15f870ae4887" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-4c5be1c2-e36f-422e-87d8-15f870ae4887" acquired by "delete_volume" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eae6c3-9e19-4581-83b2-dd420195ccbb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:31 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 Jul 27 13:19:31 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-41d9df54-ca6b-402e-99e7-1187817218d5 req-ee3886bd-1cb0-40a1-b222-e256b54617b9 tempest-AttachVolumeTestJSON-570659394 None] Terminate volume connection completed successfully. Jul 27 13:19:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-41d9df54-ca6b-402e-99e7-1187817218d5 req-ee3886bd-1cb0-40a1-b222-e256b54617b9 tempest-AttachVolumeTestJSON-570659394 None] Deleting attachment 50ebf807-7174-41b8-b308-ed72ee38c686. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:19:32 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887" returned: 0 in 0.800s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:32 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887 Jul 27 13:19:32 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:32 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4c5be1c2-e36f-422e-87d8-15f870ae4887" returned: 0 in 0.478s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-quobyte-4c5be1c2-e36f-422e-87d8-15f870ae4887" released by "delete_volume" :: held 1.360s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Created reservations ['2eca4254-f612-4304-86c4-650f49e3337d', 'f1dc0941-ab7a-4a80-8c45-be9d00cda0d5', '6817dcf1-d9d3-4293-9d44-8376adbac567', '1e190963-24f2-49c3-adb0-89bc101b0a41'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:32 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:32 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:33 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.302s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Deleted volume successfully. Jul 27 13:19:33 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:33 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cea6e643-ba65-412c-bc9c-52526cf66ef1 tempest-VolumeDependencyTests-534484580 None] Lock "cinder-4c5be1c2-e36f-422e-87d8-15f870ae4887-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:33 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:19:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:19:34 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-bfb79932-92a9-49cf-bbcc-ad117feb9549 req-23592731-ff4c-4402-b02c-d25d6bd8b150 tempest-AttachVolumeTestJSON-570659394 None] Terminate volume connection completed successfully. Jul 27 13:19:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-bfb79932-92a9-49cf-bbcc-ad117feb9549 req-23592731-ff4c-4402-b02c-d25d6bd8b150 tempest-AttachVolumeTestJSON-570659394 None] Deleting attachment e87bef06-85e4-44fd-94bf-1b30263848dc. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Flow 'volume_create_manager' (6fa7cfd8-8f80-4a4c-a4aa-fa32e5723c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955714cd-36b0-4331-a4c7-b90093704ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955714cd-36b0-4331-a4c7-b90093704ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-325478964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4dc942-4955-435b-ae0d-db87b5ead642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120fa914d80541989f9995a2e814aacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:41Z,use_quota=True,user_id='1d326e3404e9463e9ce28a918c6caff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e038ba-e6c9-42c4-aaff-330b1d6202ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e038ba-e6c9-42c4-aaff-330b1d6202ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94a1ec7-5854-4a13-964e-b6af832a2156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94a1ec7-5854-4a13-964e-b6af832a2156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d4dc942-4955-435b-ae0d-db87b5ead642', 'volume_name': 'volume-2d4dc942-4955-435b-ae0d-db87b5ead642', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7496729-719c-4094-ad6e-12e5224d5f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7496729-719c-4094-ad6e-12e5224d5f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ac5063-ec34-4bc0-9677-4468d991f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:41 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Volume 2d4dc942-4955-435b-ae0d-db87b5ead642: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d4dc942-4955-435b-ae0d-db87b5ead642', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 27 13:19:41 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Trying to clone 2d4dc942-4955-435b-ae0d-db87b5ead642 from image d5827fb8-683b-418e-8e22-9911b3a6a38f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:19:42 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Image download 20.69 MB at 20.69 MB/s Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc84d4f-7b51-4963-826c-a0d10d2288eb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:42 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD Jul 27 13:19:42 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:42 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f is fetched for user 1d326e3404e9463e9ce28a918c6caff6. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "cinder-bbad5b89-9fe8-4257-9684-95b2f62ed3d7-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a3ed7-62e6-45e0-acf5-aaf76c60d87c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-bbad5b89-9fe8-4257-9684-95b2f62ed3d7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "cinder-quobyte-bbad5b89-9fe8-4257-9684-95b2f62ed3d7" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-quobyte-bbad5b89-9fe8-4257-9684-95b2f62ed3d7" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f74c3-2bfd-47e8-87b6-d7fa7b00edba]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:42 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD Jul 27 13:19:42 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:42 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 Jul 27 13:19:42 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:43 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-325478964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4dc942-4955-435b-ae0d-db87b5ead642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120fa914d80541989f9995a2e814aacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:41Z,use_quota=True,user_id='1d326e3404e9463e9ce28a918c6caff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Creating volume 2d4dc942-4955-435b-ae0d-db87b5ead642 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:43 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:43 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 1073741824 Jul 27 13:19:43 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:43 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7" returned: 0 in 0.425s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:43 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7 Jul 27 13:19:43 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:43 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bbad5b89-9fe8-4257-9684-95b2f62ed3d7" returned: 0 in 0.329s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:43 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 1073741824" returned: 0 in 0.481s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-quobyte-bbad5b89-9fe8-4257-9684-95b2f62ed3d7" released by "delete_volume" :: held 0.804s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:43 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 Jul 27 13:19:43 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Created reservations ['f702d233-3f9c-4d72-99df-ee1e0e5703fa', '76d346f3-01d4-4407-9a58-0237651666e4', '9a97b1f2-ec56-4357-8ea1-807cdfa4b18b', '3d1f3a7b-cbc1-4175-a2a5-30caac03d8b1'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:43 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:43 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "cinder-55d1802c-7c6b-430b-a196-4870c2f5b612-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-55d1802c-7c6b-430b-a196-4870c2f5b612-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "cinder-quobyte-55d1802c-7c6b-430b-a196-4870c2f5b612" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:43 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642" returned: 0 in 0.329s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-quobyte-55d1802c-7c6b-430b-a196-4870c2f5b612" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7590325-fac6-4bd5-8f56-4f819805ef06]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:43 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Attempting download of d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume 2d4dc942-4955-435b-ae0d-db87b5ead642. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:19:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Deleted volume successfully. Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2fed093c-a138-4ede-bd78-2fdf1099fe32 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-bbad5b89-9fe8-4257-9684-95b2f62ed3d7-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad37783-8e29-47ec-af22-32373e98a104]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_ {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:44 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 Jul 27 13:19:44 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:44 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_ Jul 27 13:19:44 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:44 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612" returned: 0 in 0.444s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:44 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612 Jul 27 13:19:44 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:44 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_" returned: 0 in 0.394s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_ {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:44 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_ Jul 27 13:19:44 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:44 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-55d1802c-7c6b-430b-a196-4870c2f5b612" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-quobyte-55d1802c-7c6b-430b-a196-4870c2f5b612" released by "delete_volume" :: held 0.773s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Created reservations ['b56940f3-abd2-4ff1-b478-f5df7be1935b', '2f7bdf29-09b4-4b58-ad41-f2592b45f117', '73c7dfe2-bbba-4639-8b66-dd1c7a81e7e8', 'd0211d7a-c0ca-41f9-a914-d2f6aeeaf9e7'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:44 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_" returned: 1 in 0.355s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_u0gq_8d_' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e48eb69-6dfc-4a8f-9b34-f0b369dc6eb7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:44 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:44 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:44 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD Jul 27 13:19:44 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "cinder-35adcf26-3bad-4153-8878-f39eae62587e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:45 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-35adcf26-3bad-4153-8878-f39eae62587e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.325s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Deleted volume successfully. Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8da46e4b-99ef-40a6-913c-f1a8bb2259f9 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-55d1802c-7c6b-430b-a196-4870c2f5b612-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:45 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "cinder-quobyte-35adcf26-3bad-4153-8878-f39eae62587e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] d5827fb8-683b-418e-8e22-9911b3a6a38f was qcow2, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-quobyte-35adcf26-3bad-4153-8878-f39eae62587e" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:45 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 Jul 27 13:19:45 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd446c2-2362-4a27-9c9f-17d373038650]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:45 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e Jul 27 13:19:45 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:45 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e" returned: 0 in 0.391s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:45 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e Jul 27 13:19:45 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:46 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-35adcf26-3bad-4153-8878-f39eae62587e" returned: 0 in 0.299s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-quobyte-35adcf26-3bad-4153-8878-f39eae62587e" released by "delete_volume" :: held 0.741s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (ee931e48-19d0-40b3-9839-4f7c0264c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77610403-b3a6-4ea3-ba9d-6a45ef93cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Created reservations ['a518c9f8-fc5a-4857-84ce-34517047db89', 'd0752d1d-17bd-47f7-ae80-07750c25c8c1', 'b96ad6ec-8433-4b2e-b7d4-d3f9719e12ec', '6ffba06f-b6f1-4448-804d-de49bbb413f4'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77610403-b3a6-4ea3-ba9d-6a45ef93cf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184216074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e30e98d-b6e9-4fd3-a18d-db5170870cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:46Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64ac8c0-ff30-41ae-be38-11b5fadc6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64ac8c0-ff30-41ae-be38-11b5fadc6410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97021e5-b7ab-42f1-8f61-9285bc1dff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97021e5-b7ab-42f1-8f61-9285bc1dff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e30e98d-b6e9-4fd3-a18d-db5170870cf9', 'volume_name': 'volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b799f2-ac9c-4d67-98c7-3a4dcd17c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b799f2-ac9c-4d67-98c7-3a4dcd17c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0004db2-4f2f-4fd2-b299-17234b226ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:46 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Volume 5e30e98d-b6e9-4fd3-a18d-db5170870cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9', 'volume_size': 1} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184216074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e30e98d-b6e9-4fd3-a18d-db5170870cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:46Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Creating volume 5e30e98d-b6e9-4fd3-a18d-db5170870cf9 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:46 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:46 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 1073741824 Jul 27 13:19:46 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:46 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:46 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:46 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.290s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Deleted volume successfully. Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-331e0397-c688-4a78-bd84-f153ab314a20 tempest-AttachVolumeTestJSON-570659394 None] Lock "cinder-35adcf26-3bad-4153-8878-f39eae62587e-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:46 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 1073741824" returned: 0 in 0.591s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:46 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 Jul 27 13:19:46 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:47 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9" returned: 0 in 0.279s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0004db2-4f2f-4fd2-b299-17234b226ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d207ac-423b-4f6d-976c-b88a81963ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Volume volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 (5e30e98d-b6e9-4fd3-a18d-db5170870cf9): created successfully Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d207ac-423b-4f6d-976c-b88a81963ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (ee931e48-19d0-40b3-9839-4f7c0264c392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f04d2737-598b-4f38-93ba-b080e7ef8d7f tempest-ProjectReaderTests-1536707304 None] Created volume successfully. Jul 27 13:19:47 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642" returned: 0 in 2.031s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_obwn0ycldevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:19:47 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Converted 112.00 MB image at 55.12 MB/s Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:47 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 1G Jul 27 13:19:47 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:47 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 1G" returned: 0 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Downloaded image d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume 2d4dc942-4955-435b-ae0d-db87b5ead642 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f for user 1d326e3404e9463e9ce28a918c6caff6 is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Marking volume 2d4dc942-4955-435b-ae0d-db87b5ead642 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Copying metadata from image d5827fb8-683b-418e-8e22-9911b3a6a38f to 2d4dc942-4955-435b-ae0d-db87b5ead642. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Creating volume glance metadata for volume 2d4dc942-4955-435b-ae0d-db87b5ead642 backed by image d5827fb8-683b-418e-8e22-9911b3a6a38f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ac5063-ec34-4bc0-9677-4468d991f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4dc942-4955-435b-ae0d-db87b5ead642', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5196ab1d-af32-4a68-8564-e76de4215b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Volume volume-2d4dc942-4955-435b-ae0d-db87b5ead642 (2d4dc942-4955-435b-ae0d-db87b5ead642): created successfully Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5196ab1d-af32-4a68-8564-e76de4215b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Flow 'volume_create_manager' (6fa7cfd8-8f80-4a4c-a4aa-fa32e5723c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1cbe8c3f-73f2-4203-b317-065e47b0cef2 tempest-VolumesImageMetadata-1368427490 None] Created volume successfully. Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-5e30e98d-b6e9-4fd3-a18d-db5170870cf9-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Lock "cinder-5e30e98d-b6e9-4fd3-a18d-db5170870cf9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-quobyte-5e30e98d-b6e9-4fd3-a18d-db5170870cf9" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-5e30e98d-b6e9-4fd3-a18d-db5170870cf9" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a465a90-3c15-4653-956a-ee80e359a539]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:48 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 Jul 27 13:19:48 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:48 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9" returned: 0 in 0.482s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:48 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9 Jul 27 13:19:48 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Acquiring lock "cinder-2d4dc942-4955-435b-ae0d-db87b5ead642-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Lock "cinder-2d4dc942-4955-435b-ae0d-db87b5ead642-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:49 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Acquiring lock "cinder-quobyte-2d4dc942-4955-435b-ae0d-db87b5ead642" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5e30e98d-b6e9-4fd3-a18d-db5170870cf9" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-5e30e98d-b6e9-4fd3-a18d-db5170870cf9" released by "delete_volume" :: held 1.032s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Lock "cinder-quobyte-2d4dc942-4955-435b-ae0d-db87b5ead642" acquired by "delete_volume" :: waited 0.145s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc070c3-e868-4068-8664-7feee17ae573]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Created reservations ['b7900a30-9837-4cf3-b47f-76d843453cb2', '667f002a-1bd8-4716-9bc0-b92a6c7fe935', '4796f451-f6a9-44fb-988b-b087644707eb', '95d8a73e-8239-4267-8cc0-592266ce3679'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:49 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 Jul 27 13:19:49 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:49 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:49 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:49 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:49 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Deleted volume successfully. Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7f553ca8-145b-4db3-8c43-1350fcea275d tempest-ProjectReaderTests-1536707304 None] Lock "cinder-5e30e98d-b6e9-4fd3-a18d-db5170870cf9-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:50 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642" returned: 0 in 0.526s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:50 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642 Jul 27 13:19:50 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:50 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2d4dc942-4955-435b-ae0d-db87b5ead642" returned: 0 in 0.324s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Lock "cinder-quobyte-2d4dc942-4955-435b-ae0d-db87b5ead642" released by "delete_volume" :: held 0.959s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Created reservations ['f91ef3d8-a39b-4f12-81b5-96b80dfc8d97', '3f193841-0e09-45bf-8660-322c05038e61', '287fff00-a06d-4663-9dc4-cd580c59be16', 'af3985d1-c72f-4aad-a19a-76b50d5d866d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:50 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:50 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:50 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.319s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Deleted volume successfully. Jul 27 13:19:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eee418c8-8961-408a-ab6f-bf68c5d42c1b tempest-VolumesImageMetadata-1368427490 None] Lock "cinder-2d4dc942-4955-435b-ae0d-db87b5ead642-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (04b6deec-9e57-479d-954a-dd01617e4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc2ad11-8f45-4a25-a2d9-59a3638e8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc2ad11-8f45-4a25-a2d9-59a3638e8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328336822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d2c21e-7145-4473-a930-cd2ca5235907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:51Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9a3c09-219e-4e34-9e78-55650daabb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9a3c09-219e-4e34-9e78-55650daabb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5af7d79-b884-4e17-b53c-1bae85d25688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5af7d79-b884-4e17-b53c-1bae85d25688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d2c21e-7145-4473-a930-cd2ca5235907', 'volume_name': 'volume-08d2c21e-7145-4473-a930-cd2ca5235907', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69748428-af4f-419b-bbf7-074a5dea9110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69748428-af4f-419b-bbf7-074a5dea9110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd48cab9-d63d-4305-95fc-c68be532c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Volume 08d2c21e-7145-4473-a930-cd2ca5235907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d2c21e-7145-4473-a930-cd2ca5235907', 'volume_size': 1} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328336822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d2c21e-7145-4473-a930-cd2ca5235907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:51Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Creating volume 08d2c21e-7145-4473-a930-cd2ca5235907 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:51 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:51 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 1073741824 Jul 27 13:19:51 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:51 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 1073741824" returned: 0 in 0.578s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:51 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 Jul 27 13:19:51 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:52 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd48cab9-d63d-4305-95fc-c68be532c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d2c21e-7145-4473-a930-cd2ca5235907', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77296e14-b32b-43f5-b1b6-0653921bbe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Volume volume-08d2c21e-7145-4473-a930-cd2ca5235907 (08d2c21e-7145-4473-a930-cd2ca5235907): created successfully Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77296e14-b32b-43f5-b1b6-0653921bbe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (04b6deec-9e57-479d-954a-dd01617e4100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5e9ecac7-c5b6-4399-b678-c57cab82948e tempest-ProjectReaderTests-1536707304 None] Created volume successfully. Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-08d2c21e-7145-4473-a930-cd2ca5235907-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-08d2c21e-7145-4473-a930-cd2ca5235907-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-quobyte-08d2c21e-7145-4473-a930-cd2ca5235907" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-08d2c21e-7145-4473-a930-cd2ca5235907" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a774416-f2c9-4470-aaa4-b7d64801fba1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Flow 'volume_create_manager' (1d06a64c-ee6e-468a-9186-0cd29d37e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c222c2-3899-400a-8890-d064c4a7a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c222c2-3899-400a-8890-d064c4a7a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1985915351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2e2cc-547b-4ec4-b72e-e6067348d741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270595c216764c6aabd454783948237c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:54Z,use_quota=True,user_id='2d464e3c1ee04a7ab75cb7fcb7993bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d26a1f-3387-4246-97ac-5266fb4bf2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d26a1f-3387-4246-97ac-5266fb4bf2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce4a504-cb1c-4c9d-9bff-0944e9b61f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce4a504-cb1c-4c9d-9bff-0944e9b61f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f2e2cc-547b-4ec4-b72e-e6067348d741', 'volume_name': 'volume-71f2e2cc-547b-4ec4-b72e-e6067348d741', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883a407f-6315-4375-b4de-a21839483437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883a407f-6315-4375-b4de-a21839483437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a05d1c1-f3e2-479b-a1ed-acbc5fdaad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Volume 71f2e2cc-547b-4ec4-b72e-e6067348d741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f2e2cc-547b-4ec4-b72e-e6067348d741', 'volume_size': 1} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1985915351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2e2cc-547b-4ec4-b72e-e6067348d741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270595c216764c6aabd454783948237c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:54Z,use_quota=True,user_id='2d464e3c1ee04a7ab75cb7fcb7993bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Creating volume 71f2e2cc-547b-4ec4-b72e-e6067348d741 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:53 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:53 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 Jul 27 13:19:53 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:53 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 1073741824 Jul 27 13:19:53 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:54 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907" returned: 0 in 0.451s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:54 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907 Jul 27 13:19:54 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:54 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 1073741824" returned: 0 in 0.580s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:54 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 Jul 27 13:19:54 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Flow 'volume_create_manager' (84038df2-3ea2-4a68-b0cc-35f2113b342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:54 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8087dac-15e7-42f7-8fa3-20d394e726d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-08d2c21e-7145-4473-a930-cd2ca5235907" returned: 0 in 0.425s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8087dac-15e7-42f7-8fa3-20d394e726d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-100650091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='655fb48003cb4e73aa0ed8b57b3ae488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:54Z,use_quota=True,user_id='709b74ff65fc4f96bc7dacbf072fe4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cc5aee-7811-47ff-ac2a-bbb912001076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cc5aee-7811-47ff-ac2a-bbb912001076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f6ae61-01cf-4cd8-8eef-91cdc14076fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f6ae61-01cf-4cd8-8eef-91cdc14076fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab', 'volume_name': 'volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccd3510-a452-4c73-8ae3-841e836ae279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccd3510-a452-4c73-8ae3-841e836ae279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8bca7f-1a7f-45b9-b9f2-55402380fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Volume 3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab', 'volume_size': 1} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-08d2c21e-7145-4473-a930-cd2ca5235907" released by "delete_volume" :: held 0.984s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Created reservations ['9ac2517c-5c68-4f97-ace3-352236b94e44', '89961086-5066-4c92-831f-c5f6e7516c2a', '13f15605-2bcf-4b75-8457-d2e6d2d8c0a7', '5d92bded-43a4-4579-b6c7-2eafe7d2e4f6'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:54 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741" returned: 0 in 0.294s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-100650091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='655fb48003cb4e73aa0ed8b57b3ae488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:54Z,use_quota=True,user_id='709b74ff65fc4f96bc7dacbf072fe4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Creating volume 3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:54 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:54 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab 1073741824 Jul 27 13:19:54 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a05d1c1-f3e2-479b-a1ed-acbc5fdaad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f2e2cc-547b-4ec4-b72e-e6067348d741', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:54 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:54 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106ecb43-eea4-45aa-8d0c-18b0435362e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Volume volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 (71f2e2cc-547b-4ec4-b72e-e6067348d741): created successfully Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106ecb43-eea4-45aa-8d0c-18b0435362e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Flow 'volume_create_manager' (1d06a64c-ee6e-468a-9186-0cd29d37e287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-094d3703-4e99-413b-a176-4208b06c781e tempest-AttachVolumeNegativeTest-1681737704 None] Created volume successfully. Jul 27 13:19:54 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.293s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:54 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Deleted volume successfully. Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-454368ac-e3c2-44f0-9bba-30c15949b57b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-08d2c21e-7145-4473-a930-cd2ca5235907-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:55 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab 1073741824" returned: 0 in 0.515s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:55 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab Jul 27 13:19:55 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:55 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8bca7f-1a7f-45b9-b9f2-55402380fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3a866c-1fcd-46d3-9a8e-e04ea8e98fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Volume volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab (3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab): created successfully Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3a866c-1fcd-46d3-9a8e-e04ea8e98fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Flow 'volume_create_manager' (84038df2-3ea2-4a68-b0cc-35f2113b342b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-c0f2c593-4ef1-4785-a4f1-a179cdd0e272 req-780d7071-e6f0-479d-8c91-663d2a83e0e1 tempest-VolumesGetTestJSON-1525984712 None] Created volume successfully. Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Flow 'volume_create_manager' (04950b36-cbf9-463f-bca9-0520e7d30f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2042d002-6d59-4a5a-a3fc-60ecdce2f207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2042d002-6d59-4a5a-a3fc-60ecdce2f207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1947838135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7da076-a900-4572-be69-2fdcd3c63b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe657171b3fc44f8b97fe4ea71bf463b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:56Z,use_quota=True,user_id='aa01986e6be942afa83faf81a6297913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a97b3e-35b3-4c64-bad0-4efefbd69a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a97b3e-35b3-4c64-bad0-4efefbd69a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d90eb07-34cd-418f-acc3-7b9eb870630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d90eb07-34cd-418f-acc3-7b9eb870630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7da076-a900-4572-be69-2fdcd3c63b17', 'volume_name': 'volume-fc7da076-a900-4572-be69-2fdcd3c63b17', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae419a7-9543-4ec5-b24a-50b4d5a3dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae419a7-9543-4ec5-b24a-50b4d5a3dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a7a67-fd89-44e2-aef8-57539b5d6ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Volume fc7da076-a900-4572-be69-2fdcd3c63b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7da076-a900-4572-be69-2fdcd3c63b17', 'volume_size': 1} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1947838135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7da076-a900-4572-be69-2fdcd3c63b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe657171b3fc44f8b97fe4ea71bf463b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:56Z,use_quota=True,user_id='aa01986e6be942afa83faf81a6297913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Creating volume fc7da076-a900-4572-be69-2fdcd3c63b17 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:56 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 1073741824 Jul 27 13:19:56 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (dcc5b2fa-b2b2-4b20-889c-b68b8b37487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecfbd6b-b94b-4750-a0e4-e36f217ab9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecfbd6b-b94b-4750-a0e4-e36f217ab9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861150084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50894ad-4069-4401-93ab-d0f7289fb537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:56Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bb3c20-3810-4206-987f-534296d51b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bb3c20-3810-4206-987f-534296d51b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231e4597-134c-413e-bc2b-6ef71b0f42d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231e4597-134c-413e-bc2b-6ef71b0f42d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50894ad-4069-4401-93ab-d0f7289fb537', 'volume_name': 'volume-a50894ad-4069-4401-93ab-d0f7289fb537', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd17b34-3696-40a3-97ad-0a0fdd5c99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd17b34-3696-40a3-97ad-0a0fdd5c99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b494dc-6935-48fa-84e6-206fbdfe6180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Volume a50894ad-4069-4401-93ab-d0f7289fb537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50894ad-4069-4401-93ab-d0f7289fb537', 'volume_size': 1} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-1bdee692-7338-4d3f-9a3b-0bb761fc1004 req-f8b31e09-0635-4095-8cfd-34e265d61207 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:56 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 1073741824" returned: 0 in 0.464s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:56 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 Jul 27 13:19:56 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Acquiring lock "cinder-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Lock "cinder-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Acquiring lock "cinder-quobyte-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Lock "cinder-quobyte-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7fced1-2fe5-4cd5-8625-f76e5c6ca918]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:57 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17" returned: 0 in 0.276s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861150084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50894ad-4069-4401-93ab-d0f7289fb537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:19:56Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Creating volume a50894ad-4069-4401-93ab-d0f7289fb537 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:19:57 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a7a67-fd89-44e2-aef8-57539b5d6ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7da076-a900-4572-be69-2fdcd3c63b17', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca59207-d0dc-4dd0-9485-1d5c45c49fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:57 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 1073741824 Jul 27 13:19:57 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:57 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Volume volume-fc7da076-a900-4572-be69-2fdcd3c63b17 (fc7da076-a900-4572-be69-2fdcd3c63b17): created successfully Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca59207-d0dc-4dd0-9485-1d5c45c49fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:57 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab Jul 27 13:19:57 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Flow 'volume_create_manager' (04950b36-cbf9-463f-bca9-0520e7d30f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c3359bf2-5e91-4b4d-8c86-8ea0695cafae tempest-AbsoluteLimitsTests-1540185976 None] Created volume successfully. Jul 27 13:19:57 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab" returned: 0 in 0.413s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:57 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab Jul 27 13:19:57 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:57 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 1073741824" returned: 0 in 0.445s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:57 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 Jul 27 13:19:57 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:57 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Lock "cinder-quobyte-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab" released by "delete_volume" :: held 0.742s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.quota [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Created reservations ['9a46de1a-5b55-479f-bb0e-4b7f74337d87', '9badd17e-e635-401a-a284-613968b20b62', '090cb2d4-9687-4fab-a72c-2f416da433a1', 'f04001cf-c214-44ce-b9ca-2f4cf3a11894'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:57 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537" returned: 0 in 0.275s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-1bdee692-7338-4d3f-9a3b-0bb761fc1004 req-f8b31e09-0635-4095-8cfd-34e265d61207 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.303s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b494dc-6935-48fa-84e6-206fbdfe6180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50894ad-4069-4401-93ab-d0f7289fb537', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d08ec-8a11-4a30-9a50-95105069cc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-1bdee692-7338-4d3f-9a3b-0bb761fc1004 req-f8b31e09-0635-4095-8cfd-34e265d61207 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:57 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Volume volume-a50894ad-4069-4401-93ab-d0f7289fb537 (a50894ad-4069-4401-93ab-d0f7289fb537): created successfully Jul 27 13:19:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d08ec-8a11-4a30-9a50-95105069cc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (dcc5b2fa-b2b2-4b20-889c-b68b8b37487e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-edba47a7-066d-444a-b8e3-aff0d0856bd0 tempest-ProjectReaderTests-1536707304 None] Created volume successfully. Jul 27 13:19:58 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:58 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-1bdee692-7338-4d3f-9a3b-0bb761fc1004 req-f8b31e09-0635-4095-8cfd-34e265d61207 tempest-AttachVolumeNegativeTest-1681737704 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-71f2e2cc-547b-4ec4-b72e-e6067348d741', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59a7a171-20a7-4d5f-8b5b-790e5fdd7364', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:19:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-1bdee692-7338-4d3f-9a3b-0bb761fc1004 req-f8b31e09-0635-4095-8cfd-34e265d61207 tempest-AttachVolumeNegativeTest-1681737704 None] attachment_update completed successfully. Jul 27 13:19:58 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.manager [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:19:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Deleted volume successfully. Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-409985b9-cd6c-4f15-9609-edd54bac408a req-01ea3c9f-fdb1-4744-86ad-3cae33a9f515 tempest-VolumesGetTestJSON-1525984712 None] Lock "cinder-3f0bc8e3-97e1-4e34-a5b4-73c64fd04fab-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-a50894ad-4069-4401-93ab-d0f7289fb537-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Acquiring lock "cinder-fc7da076-a900-4572-be69-2fdcd3c63b17-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-a50894ad-4069-4401-93ab-d0f7289fb537-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Lock "cinder-fc7da076-a900-4572-be69-2fdcd3c63b17-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-quobyte-a50894ad-4069-4401-93ab-d0f7289fb537" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Acquiring lock "cinder-quobyte-fc7da076-a900-4572-be69-2fdcd3c63b17" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Lock "cinder-quobyte-fc7da076-a900-4572-be69-2fdcd3c63b17" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-a50894ad-4069-4401-93ab-d0f7289fb537" acquired by "delete_volume" :: waited 0.058s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[40267522-ed03-447c-a894-71c284365882]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b2ce33-baad-4dc6-b238-4060a4d4d5a8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:19:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:58 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 Jul 27 13:19:58 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:58 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 Jul 27 13:19:58 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:59 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17" returned: 0 in 0.471s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:59 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537" returned: 0 in 0.470s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:59 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17 Jul 27 13:19:59 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:59 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537 Jul 27 13:19:59 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:59 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc7da076-a900-4572-be69-2fdcd3c63b17" returned: 0 in 0.310s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Lock "cinder-quobyte-fc7da076-a900-4572-be69-2fdcd3c63b17" released by "delete_volume" :: held 0.835s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:59 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a50894ad-4069-4401-93ab-d0f7289fb537" returned: 0 in 0.321s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-a50894ad-4069-4401-93ab-d0f7289fb537" released by "delete_volume" :: held 0.846s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Created reservations ['c5b95cbe-cd38-422e-a744-0e9d02b31561', '6949eac2-2225-4b1a-896e-99d3a221709c', '724abca6-f08e-46ec-8704-ccb90398d412', '6953edef-166b-4e2b-acf4-75a22229752a'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Created reservations ['5cce2fbd-d2fe-4dbb-9f82-ac3d639d943c', 'e87aec50-a948-4585-aa2f-511592d6d3f7', 'd1553e34-eb7f-44e1-b234-4d9569c90845', 'cfa897ee-e4db-456d-8270-a8dc8ef3790b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:59 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:59 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:19:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:19:59 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:19:59 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:00 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.502s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Deleted volume successfully. Jul 27 13:20:00 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.449s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Deleted volume successfully. Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b68fdfbe-e9b7-4e7f-8543-c5ecce8bf51c tempest-AbsoluteLimitsTests-1540185976 None] Lock "cinder-fc7da076-a900-4572-be69-2fdcd3c63b17-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c8736af-b020-4d8a-9bf8-529cc53c7f5b tempest-ProjectReaderTests-1536707304 None] Lock "cinder-a50894ad-4069-4401-93ab-d0f7289fb537-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (bf397c57-2cce-4f10-b34b-fa9ad0df72ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28608d63-af13-4bb4-8c22-1d35712e5fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28608d63-af13-4bb4-8c22-1d35712e5fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1865298903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b657eb3-6126-40da-a0a8-2e64bfce1bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:00Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fa3405-5efc-4881-80ff-587ba2d158b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fa3405-5efc-4881-80ff-587ba2d158b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6d8fd0-9bb1-4dac-8208-8891f31fed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6d8fd0-9bb1-4dac-8208-8891f31fed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b657eb3-6126-40da-a0a8-2e64bfce1bcd', 'volume_name': 'volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4db866-490c-4c90-b7ba-4e0dd67bdd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4db866-490c-4c90-b7ba-4e0dd67bdd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16567502-12da-43c8-adf7-0c5886c5c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:00 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Volume 3b657eb3-6126-40da-a0a8-2e64bfce1bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd', 'volume_size': 1} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1865298903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b657eb3-6126-40da-a0a8-2e64bfce1bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7434491924458ebda9391eb7ed50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:00Z,use_quota=True,user_id='d31d4a7f03044bbf9dbb0b034d7c0d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Creating volume 3b657eb3-6126-40da-a0a8-2e64bfce1bcd {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:00 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:00 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd 1073741824 Jul 27 13:20:00 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-9f6fbb61-6d0d-4668-b783-2d9a3a36425c req-7b0c4972-d97a-4b32-b66d-6f234659905f tempest-AttachVolumeNegativeTest-1681737704 None] Terminate volume connection completed successfully. Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-9f6fbb61-6d0d-4668-b783-2d9a3a36425c req-7b0c4972-d97a-4b32-b66d-6f234659905f tempest-AttachVolumeNegativeTest-1681737704 None] Deleting attachment 59a7a171-20a7-4d5f-8b5b-790e5fdd7364. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:20:01 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd 1073741824" returned: 0 in 0.603s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:01 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd Jul 27 13:20:01 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:01 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd" returned: 0 in 0.360s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16567502-12da-43c8-adf7-0c5886c5c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2982e24f-dc8b-4ea3-8973-8b5c69bff85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:01 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Volume volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd (3b657eb3-6126-40da-a0a8-2e64bfce1bcd): created successfully Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2982e24f-dc8b-4ea3-8973-8b5c69bff85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Flow 'volume_create_manager' (bf397c57-2cce-4f10-b34b-fa9ad0df72ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a8328504-59c4-4db4-89b7-7df68e86e845 tempest-ProjectReaderTests-1536707304 None] Created volume successfully. Jul 27 13:20:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-3b657eb3-6126-40da-a0a8-2e64bfce1bcd-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Lock "cinder-3b657eb3-6126-40da-a0a8-2e64bfce1bcd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "cinder-quobyte-3b657eb3-6126-40da-a0a8-2e64bfce1bcd" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-3b657eb3-6126-40da-a0a8-2e64bfce1bcd" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb001e6-f57f-48b4-b475-2c616fa48a49]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:03 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd Jul 27 13:20:03 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:03 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd" returned: 0 in 0.560s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:03 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd Jul 27 13:20:03 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:03 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b657eb3-6126-40da-a0a8-2e64bfce1bcd" returned: 0 in 0.417s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Lock "cinder-quobyte-3b657eb3-6126-40da-a0a8-2e64bfce1bcd" released by "delete_volume" :: held 1.041s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Created reservations ['0f10f635-a349-4df5-adc4-1c14ce8caf61', 'ddb3ad0b-533c-4ab8-ac72-caaf64632840', '48841edc-2d7b-4a60-8f33-b676758e4fdb', '0c9f4fdd-6303-462a-b040-078a81513b5a'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:04 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:04 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:04 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.418s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Deleted volume successfully. Jul 27 13:20:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a6d7dbe6-33ad-4615-bada-c371702c8997 tempest-ProjectReaderTests-1536707304 None] Lock "cinder-3b657eb3-6126-40da-a0a8-2e64bfce1bcd-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "cinder-71f2e2cc-547b-4ec4-b72e-e6067348d741-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-71f2e2cc-547b-4ec4-b72e-e6067348d741-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "cinder-quobyte-71f2e2cc-547b-4ec4-b72e-e6067348d741" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-quobyte-71f2e2cc-547b-4ec4-b72e-e6067348d741" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[697db462-9c42-413e-90e4-438eaeb74b46]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:07 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 Jul 27 13:20:07 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:08 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741" returned: 0 in 0.447s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:08 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741 Jul 27 13:20:08 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:08 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-71f2e2cc-547b-4ec4-b72e-e6067348d741" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-quobyte-71f2e2cc-547b-4ec4-b72e-e6067348d741" released by "delete_volume" :: held 0.876s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Flow 'volume_create_manager' (7926ad51-5795-4ab3-9144-bd5ed1814cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2786f3-9c6c-4439-854a-df15d6a332f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2786f3-9c6c-4439-854a-df15d6a332f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-367012106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8415dd-b348-46ef-9112-b5514611914b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba728dbab9224752963c4b7e3cd29cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:09Z,use_quota=True,user_id='69de60e49945424285f65206cea63007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5e6c0-3d3e-492d-b045-8cc6f1ba1446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5e6c0-3d3e-492d-b045-8cc6f1ba1446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aa4117-a9f2-4274-b1b5-54ed43612aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aa4117-a9f2-4274-b1b5-54ed43612aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8415dd-b348-46ef-9112-b5514611914b', 'volume_name': 'volume-fa8415dd-b348-46ef-9112-b5514611914b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84427b3d-3a49-4316-a598-49fa7b5e4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84427b3d-3a49-4316-a598-49fa7b5e4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5180b3d-ff71-4ed1-9998-067587229155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Volume fa8415dd-b348-46ef-9112-b5514611914b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8415dd-b348-46ef-9112-b5514611914b', 'volume_size': 1} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-367012106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8415dd-b348-46ef-9112-b5514611914b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba728dbab9224752963c4b7e3cd29cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:09Z,use_quota=True,user_id='69de60e49945424285f65206cea63007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Creating volume fa8415dd-b348-46ef-9112-b5514611914b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:08 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:08 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b 1073741824 Jul 27 13:20:08 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Created reservations ['ebd866fa-3d3f-41f2-84a9-ce3dad5c713a', 'b4016c5c-112a-46e9-91d2-3e000e393942', '6054dc2f-dc48-4e8e-ad3c-7eda15418925', '7126be3c-854c-47b6-984e-fa059d1b3f1c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:08 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:08 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:09 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.339s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Deleted volume successfully. Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-137df98c-251e-4657-8e72-29135c09acec tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-71f2e2cc-547b-4ec4-b72e-e6067348d741-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fe5a0f90-94d4-4326-9957-3463c4ccdd9c tempest-BackendsCapabilitiesAdminTestsJSON-1501065374 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88202) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f496c494-072d-4658-8f4b-9b9eeb1087f8 tempest-BackendsCapabilitiesAdminTestsJSON-1501065374 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88202) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 27 13:20:09 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b 1073741824" returned: 0 in 0.613s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:09 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b Jul 27 13:20:09 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:09 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b" returned: 0 in 0.314s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5180b3d-ff71-4ed1-9998-067587229155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8415dd-b348-46ef-9112-b5514611914b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdbeec6-ad53-45ab-8efd-f5689372e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:09 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Volume volume-fa8415dd-b348-46ef-9112-b5514611914b (fa8415dd-b348-46ef-9112-b5514611914b): created successfully Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdbeec6-ad53-45ab-8efd-f5689372e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Flow 'volume_create_manager' (7926ad51-5795-4ab3-9144-bd5ed1814cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a16ae6c9-7fa7-43d3-adeb-8313edbff135 tempest-VolumesTransfersTest-1872029870 None] Created volume successfully. Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "cinder-c66553a7-932a-41f9-9f44-f845e516e924-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-c66553a7-932a-41f9-9f44-f845e516e924-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "cinder-quobyte-c66553a7-932a-41f9-9f44-f845e516e924" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-quobyte-c66553a7-932a-41f9-9f44-f845e516e924" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[12970740-e865-474c-9ddf-85aebe008b14]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:10 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 Jul 27 13:20:10 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:10 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924" returned: 0 in 0.454s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:10 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924 Jul 27 13:20:10 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:10 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c66553a7-932a-41f9-9f44-f845e516e924" returned: 0 in 0.300s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-quobyte-c66553a7-932a-41f9-9f44-f845e516e924" released by "delete_volume" :: held 0.812s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Created reservations ['37fb9a61-3911-45cd-a46e-f54c91137403', '01927aa8-e761-4f1c-b8c9-8dbca22d1748', '1697f38b-73b1-4505-8f59-02936bba3b48', 'ef1300d4-d8a0-4d4b-8398-dd2c20260420'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:11 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:11 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-75bf56d0-9fe9-42f1-af08-cb5f52aa98fb tempest-VolumesTransfersTest-1348778933 None] Transfer volume completed successfully. Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "cinder-c52b40f5-0f69-4117-ac18-3393e60737c4-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:11 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.506s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Deleted volume successfully. Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-c52b40f5-0f69-4117-ac18-3393e60737c4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aa3304fe-caef-491d-b60c-452cffe85b62 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-c66553a7-932a-41f9-9f44-f845e516e924-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "cinder-quobyte-c52b40f5-0f69-4117-ac18-3393e60737c4" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-quobyte-c52b40f5-0f69-4117-ac18-3393e60737c4" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d616daf-d13a-4049-900e-f41618a88f70]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:11 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 Jul 27 13:20:11 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:12 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4" returned: 0 in 0.474s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:12 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4 Jul 27 13:20:12 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Acquiring lock "cinder-fa8415dd-b348-46ef-9112-b5514611914b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-fa8415dd-b348-46ef-9112-b5514611914b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Acquiring lock "cinder-quobyte-fa8415dd-b348-46ef-9112-b5514611914b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:12 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c52b40f5-0f69-4117-ac18-3393e60737c4" returned: 0 in 0.345s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-quobyte-fa8415dd-b348-46ef-9112-b5514611914b" acquired by "delete_volume" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-quobyte-c52b40f5-0f69-4117-ac18-3393e60737c4" released by "delete_volume" :: held 0.885s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b399df-40b6-4f4d-9942-925eb7c563b6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Created reservations ['84ea7fdf-a777-4393-bd8b-66d3be05cd17', '154a30b3-2024-412e-9b5c-21761f57410a', 'b7b8ab41-52ec-4e87-bfbb-63c33f3bc4e7', 'ffb375f1-0d6c-4454-becf-a9d2b50f22d5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:12 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:12 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:12 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:12 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:13 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.285s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:13 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Deleted volume successfully. Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b" returned: 0 in 0.501s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1464c162-7516-4d30-82f9-909ac0efe645 tempest-AttachVolumeNegativeTest-1681737704 None] Lock "cinder-c52b40f5-0f69-4117-ac18-3393e60737c4-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:13 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b Jul 27 13:20:13 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:13 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fa8415dd-b348-46ef-9112-b5514611914b" returned: 0 in 0.337s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-quobyte-fa8415dd-b348-46ef-9112-b5514611914b" released by "delete_volume" :: held 0.905s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Created reservations ['790f7644-6470-4595-8c71-d9d384a85f06', '26c99b0e-274d-401d-850c-02aa8e9a2f60', '5cd23020-5f01-4b3e-851b-8e7ef9fa3913', '43199748-1c8e-4149-8add-4c3d45e7e2be'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:13 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:13 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:13 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:13 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Deleted volume successfully. Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0f0853d-edf3-475e-a5f5-56dc9bc77873 tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-fa8415dd-b348-46ef-9112-b5514611914b-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Flow 'volume_create_manager' (0efc068e-e222-4c7f-81b2-d6b6b0c564ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16e89f0-4c0e-4aba-a4d2-811507ffb6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16e89f0-4c0e-4aba-a4d2-811507ffb6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-637529397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dbf7c7-b065-419b-aedf-8ef80c231855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba728dbab9224752963c4b7e3cd29cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:14Z,use_quota=True,user_id='69de60e49945424285f65206cea63007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105f0a44-16a4-406d-80ce-92b8ee824f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105f0a44-16a4-406d-80ce-92b8ee824f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f486f0f-cee2-436e-87d7-41d9dd2311cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f486f0f-cee2-436e-87d7-41d9dd2311cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5dbf7c7-b065-419b-aedf-8ef80c231855', 'volume_name': 'volume-b5dbf7c7-b065-419b-aedf-8ef80c231855', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a9f935-3a6a-4578-b9d6-0878806dac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a9f935-3a6a-4578-b9d6-0878806dac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41556b0-b17d-41e4-b075-d1ba6b704d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:14 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Volume b5dbf7c7-b065-419b-aedf-8ef80c231855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5dbf7c7-b065-419b-aedf-8ef80c231855', 'volume_size': 1} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-637529397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dbf7c7-b065-419b-aedf-8ef80c231855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba728dbab9224752963c4b7e3cd29cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:14Z,use_quota=True,user_id='69de60e49945424285f65206cea63007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Creating volume b5dbf7c7-b065-419b-aedf-8ef80c231855 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:14 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:14 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 1073741824 Jul 27 13:20:14 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:15 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 1073741824" returned: 0 in 0.605s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:15 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 Jul 27 13:20:15 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:15 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41556b0-b17d-41e4-b075-d1ba6b704d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5dbf7c7-b065-419b-aedf-8ef80c231855', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81396ff0-dbbe-49da-8fb7-6dd30286d2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:15 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Volume volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 (b5dbf7c7-b065-419b-aedf-8ef80c231855): created successfully Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81396ff0-dbbe-49da-8fb7-6dd30286d2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Flow 'volume_create_manager' (0efc068e-e222-4c7f-81b2-d6b6b0c564ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-79ceb1b7-27eb-4daa-a61f-119a2e126cd1 tempest-VolumesTransfersTest-1872029870 None] Created volume successfully. Jul 27 13:20:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2b96bdff-bcaa-4689-b34d-51272686aba8 tempest-GroupsV314Test-1913513364 None] Group tempest-GroupsV314Test-Group-384621645: creating Jul 27 13:20:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2b96bdff-bcaa-4689-b34d-51272686aba8 tempest-GroupsV314Test-1913513364 None] Group tempest-GroupsV314Test-Group-384621645: created successfully Jul 27 13:20:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2b96bdff-bcaa-4689-b34d-51272686aba8 tempest-GroupsV314Test-1913513364 None] Create group completed successfully. Jul 27 13:20:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Acquiring lock "cinder-b5dbf7c7-b065-419b-aedf-8ef80c231855-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-b5dbf7c7-b065-419b-aedf-8ef80c231855-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Acquiring lock "cinder-quobyte-b5dbf7c7-b065-419b-aedf-8ef80c231855" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-quobyte-b5dbf7c7-b065-419b-aedf-8ef80c231855" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7383b5a5-840c-4049-88a7-9c67ccfe92e9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:17 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 Jul 27 13:20:17 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:17 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855" returned: 0 in 0.570s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:17 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855 Jul 27 13:20:17 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:17 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b5dbf7c7-b065-419b-aedf-8ef80c231855" returned: 0 in 0.357s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-quobyte-b5dbf7c7-b065-419b-aedf-8ef80c231855" released by "delete_volume" :: held 0.993s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Created reservations ['3791890a-a4da-4318-87ac-52fdbdac4e90', 'f85f12cc-dfa0-4fdc-8cba-894eda2c114d', '80611a36-8935-4dfa-8a88-014015262965', '9732fb79-d62c-465d-a9c9-ed67c1d5fee3'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Flow 'volume_create_manager' (14a83e3a-89ae-4bfa-afca-27341b1f47cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15912896-7be0-4591-82ec-72cb0a5a564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15912896-7be0-4591-82ec-72cb0a5a564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000226797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0be5fda9-2786-4a1e-aa05-f4ec81e0d258,host='devstack@QuobyteHD#QuobyteHD',id=9287c690-a042-4365-88fb-ee496e1d3207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b210327d1f924f1890dcb7802684183f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:18Z,use_quota=True,user_id='576086f594804b218be5c241372b65fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ebe74d6-8387-4740-8669-635db78a7f33),volume_type_id=2ebe74d6-8387-4740-8669-635db78a7f33)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8607fbfc-68a0-4ec8-866f-6a7e0cfdb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8607fbfc-68a0-4ec8-866f-6a7e0cfdb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db45acc-fdc1-4c8e-9f43-b909920249c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db45acc-fdc1-4c8e-9f43-b909920249c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9287c690-a042-4365-88fb-ee496e1d3207', 'volume_name': 'volume-9287c690-a042-4365-88fb-ee496e1d3207', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa13935a-1408-4c1c-8c58-298997c5120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa13935a-1408-4c1c-8c58-298997c5120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d533df-2a3d-492a-9fe0-b1e30906cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:18 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Volume 9287c690-a042-4365-88fb-ee496e1d3207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9287c690-a042-4365-88fb-ee496e1d3207', 'volume_size': 1} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0be5fda9-2786-4a1e-aa05-f4ec81e0d258,created_at=2026-07-27T11:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000226797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0be5fda9-2786-4a1e-aa05-f4ec81e0d258,host='devstack@QuobyteHD#QuobyteHD',id=9287c690-a042-4365-88fb-ee496e1d3207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b210327d1f924f1890dcb7802684183f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:18Z,use_quota=True,user_id='576086f594804b218be5c241372b65fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ebe74d6-8387-4740-8669-635db78a7f33),volume_type_id=2ebe74d6-8387-4740-8669-635db78a7f33)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Creating volume 9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:18 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:18 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 1073741824 Jul 27 13:20:18 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:18 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:18 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:18 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.431s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:18 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Deleted volume successfully. Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5664e176-ef1c-403f-ac49-2ede94397dad tempest-VolumesTransfersTest-2113619952 None] Lock "cinder-b5dbf7c7-b065-419b-aedf-8ef80c231855-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:18 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 1073741824" returned: 0 in 0.612s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:19 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:19 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:19 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.381s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d533df-2a3d-492a-9fe0-b1e30906cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9287c690-a042-4365-88fb-ee496e1d3207', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646f6c04-2254-4e80-bc7d-eb5d1b49b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:19 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Volume volume-9287c690-a042-4365-88fb-ee496e1d3207 (9287c690-a042-4365-88fb-ee496e1d3207): created successfully Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646f6c04-2254-4e80-bc7d-eb5d1b49b16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Flow 'volume_create_manager' (14a83e3a-89ae-4bfa-afca-27341b1f47cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:19 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-53c9b8eb-1ddd-4ded-8ad6-ce682c1500c3 tempest-GroupsV314Test-1913513364 None] Created volume successfully. Jul 27 13:20:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:21 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Cloning volume 9287c690-a042-4365-88fb-ee496e1d3207 to volume 45204dd1-feaf-4c28-abbd-54c19f2a8863 Jul 27 13:20:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Creating offline snapshot 35238e62-1671-4910-85fa-91ef2e6653e0 of volume 9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:21 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2982bd-475c-491e-9ede-559b7e11c240]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:21 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:21 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:22 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.641s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:22 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 1G Jul 27 13:20:22 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:22 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 1G" returned: 0 in 0.633s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9287c690-a042-4365-88fb-ee496e1d3207 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:23 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9287c690-a042-4365-88fb-ee496e1d3207 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 Jul 27 13:20:23 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:23 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9287c690-a042-4365-88fb-ee496e1d3207 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0" returned: 0 in 0.607s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:23 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:20:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:23 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 Jul 27 13:20:23 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:23 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0" returned: 0 in 0.359s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:24 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info Jul 27 13:20:24 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Flow 'volume_create_manager' (92c2a742-5d11-4800-acb5-5c8300e2600c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02193928-a808-4efa-aee6-69236e8e5405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02193928-a808-4efa-aee6-69236e8e5405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1211929545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f43b18-cbb8-4ea3-b897-b268ea97b7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3cca3d0e304e4f9901d27e033fda60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:24Z,use_quota=True,user_id='9f762a81a95944bea5648636635ef3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f450e6-cc2b-4193-809f-abbcd47cf3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f450e6-cc2b-4193-809f-abbcd47cf3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4017f640-882d-4765-9567-be8574eb3634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4017f640-882d-4765-9567-be8574eb3634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f43b18-cbb8-4ea3-b897-b268ea97b7d3', 'volume_name': 'volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0595bf1-345e-4e74-bc40-27a77f454ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:24 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0595bf1-345e-4e74-bc40-27a77f454ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52f7dc5-63ef-4c3e-a972-e6cbc25a1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3', 'volume_size': 1} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info" returned: 0 in 0.422s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:24 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:24 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info Jul 27 13:20:24 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:24 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.info" returned: 0 in 0.306s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Acquiring lock "cinder-quobyte-45204dd1-feaf-4c28-abbd-54c19f2a8863" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-45204dd1-feaf-4c28-abbd-54c19f2a8863" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] snapshot: 35238e62-1671-4910-85fa-91ef2e6653e0, volume: 45204dd1-feaf-4c28-abbd-54c19f2a8863, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8adb1f-fc1a-4831-ab78-0169f3bd9af7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:25 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 Jul 27 13:20:25 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:25 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0" returned: 0 in 0.469s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9287c690-a042-4365-88fb-ee496e1d3207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e7827-bba3-47fc-b3df-ef02b5de910b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:25 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:25 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:25 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.482s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:20:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:25 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 Jul 27 13:20:25 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:29 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=188,cinder:SELECT=153,cinder:INSERT=43,cinder:DELETE=14 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:20:29 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:DELETE=16,cinder:UPDATE=182,cinder:INSERT=56,cinder:SELECT=139 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Flow 'volume_create_manager' (eb9f0f03-6519-40f9-8d52-ffd3eff406fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b811a2e-0a56-48ba-a066-6eac739344cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b811a2e-0a56-48ba-a066-6eac739344cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-198703361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a901783a-1f28-4293-a678-ae311a482bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820984b3377f4ed193c6bfb5c1207c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:30Z,use_quota=True,user_id='7ee6e57f0f3d4822b52ce410e1beaa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77daa987-8351-4584-9503-95273732d051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77daa987-8351-4584-9503-95273732d051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091a9c8-6f63-4335-845f-dd73517c65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:20:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091a9c8-6f63-4335-845f-dd73517c65af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a901783a-1f28-4293-a678-ae311a482bca', 'volume_name': 'volume-a901783a-1f28-4293-a678-ae311a482bca', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0adaec9-59c6-4cd9-adf7-c27042a8d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0adaec9-59c6-4cd9-adf7-c27042a8d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f8b812-c362-46f9-b550-f37173e5b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Volume a901783a-1f28-4293-a678-ae311a482bca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a901783a-1f28-4293-a678-ae311a482bca', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Trying to clone a901783a-1f28-4293-a678-ae311a482bca from image d5827fb8-683b-418e-8e22-9911b3a6a38f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:20:31 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863" returned: 0 in 5.541s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff7aedd-e579-43e6-afd0-63014f47fc2d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:31 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:31 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:20:31 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Image download 20.69 MB at 20.69 MB/s Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f282cb98-cd40-4a0a-a3f8-08c45ba7da01]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:31 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD Jul 27 13:20:31 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:32 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f is fetched for user 7ee6e57f0f3d4822b52ce410e1beaa5e. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:20:32 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.791s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:20:32 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Converted 1024.00 MB image at 184.77 MB/s Jul 27 13:20:32 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 is being set with open permissions: ugo+rw: NotImplementedError Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62bb2bb-9291-4d36-aae9-59e2d04f420d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:32 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 Jul 27 13:20:32 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:32 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD Jul 27 13:20:32 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:32 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863" returned: 0 in 0.371s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-45204dd1-feaf-4c28-abbd-54c19f2a8863" released by "_copy_volume_from_snapshot" :: held 7.773s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:32 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Acquiring lock "cinder-quobyte-35238e62-1671-4910-85fa-91ef2e6653e0" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-35238e62-1671-4910-85fa-91ef2e6653e0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Deleting offline snapshot 35238e62-1671-4910-85fa-91ef2e6653e0 of volume 9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] snapshot_file for this snap is: volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2e463-7ce1-454c-adf6-97e1a950af00]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:32 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 Jul 27 13:20:32 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:33 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:33 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:33 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0" returned: 0 in 0.453s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9287c690-a042-4365-88fb-ee496e1d3207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c1a782-f889-464d-af49-a7101f224a47]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:33 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:33 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:33 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:20:33 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.483s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:33 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 Jul 27 13:20:33 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:34 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:34 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0 Jul 27 13:20:34 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:34 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207.35238e62-1671-4910-85fa-91ef2e6653e0" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-35238e62-1671-4910-85fa-91ef2e6653e0" released by "_delete_snapshot" :: held 1.745s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.774s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.936s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1211929545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f43b18-cbb8-4ea3-b897-b268ea97b7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3cca3d0e304e4f9901d27e033fda60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:24Z,use_quota=True,user_id='9f762a81a95944bea5648636635ef3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Creating volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:34 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:34 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 1073741824 Jul 27 13:20:34 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:34 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2a42058a-c931-45ce-aeba-6bb4a0f4a04f tempest-GroupsV314Test-1913513364 None] Create group from source-group-0be5fda9-2786-4a1e-aa05-f4ec81e0d258 completed successfully. Jul 27 13:20:35 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 1073741824" returned: 0 in 0.585s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:35 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 Jul 27 13:20:35 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:35 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" returned: 0 in 0.440s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-198703361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a901783a-1f28-4293-a678-ae311a482bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820984b3377f4ed193c6bfb5c1207c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:30Z,use_quota=True,user_id='7ee6e57f0f3d4822b52ce410e1beaa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Creating volume a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:35 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:35 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 1073741824 Jul 27 13:20:35 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52f7dc5-63ef-4c3e-a972-e6cbc25a1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66eaf91-7de2-4bf8-969b-f8a76871fb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Acquiring lock "cinder-quobyte-45204dd1-feaf-4c28-abbd-54c19f2a8863" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:35 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Volume volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 (b7f43b18-cbb8-4ea3-b897-b268ea97b7d3): created successfully Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66eaf91-7de2-4bf8-969b-f8a76871fb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Flow 'volume_create_manager' (92c2a742-5d11-4800-acb5-5c8300e2600c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-debfdbc4-008f-4711-a9d0-543d0a6a2a81 tempest-SnapshotsActionsTest-513569797 None] Created volume successfully. Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-45204dd1-feaf-4c28-abbd-54c19f2a8863" acquired by "delete_volume" :: waited 0.043s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[79da4f28-569b-460a-88f2-d07f1ec2fda5]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:35 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 Jul 27 13:20:35 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:36 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 1073741824" returned: 0 in 0.542s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:36 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863" returned: 0 in 0.398s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:36 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863 Jul 27 13:20:36 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:36 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca Jul 27 13:20:36 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:36 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:36 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca" returned: 0 in 0.280s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-45204dd1-feaf-4c28-abbd-54c19f2a8863" returned: 0 in 0.304s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-45204dd1-feaf-4c28-abbd-54c19f2a8863" released by "delete_volume" :: held 0.767s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Flow 'volume_create_manager' (6e0d0dac-e243-4139-8db2-b72ed2409cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd13abdd-a2f1-4b9e-96c6-172fb49011f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Attempting download of d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume a901783a-1f28-4293-a678-ae311a482bca. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd13abdd-a2f1-4b9e-96c6-172fb49011f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1361312672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4928e9-5faf-455f-a753-d70f8ed61623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487b37cf06224b60bc2a1cf1be44dc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:36Z,use_quota=True,user_id='39cb7ff702f14f679ff165d4a0742969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d323583e-b57a-49cb-a27c-c8ca7561a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d323583e-b57a-49cb-a27c-c8ca7561a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c9f9f8-cd14-4396-afd3-63530341ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c9f9f8-cd14-4396-afd3-63530341ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4928e9-5faf-455f-a753-d70f8ed61623', 'volume_name': 'volume-ef4928e9-5faf-455f-a753-d70f8ed61623', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf49589f-011b-45d2-a150-8213896c9f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf49589f-011b-45d2-a150-8213896c9f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ba7b4b-1043-400d-8133-566f1672a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:36 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Volume ef4928e9-5faf-455f-a753-d70f8ed61623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4928e9-5faf-455f-a753-d70f8ed61623', 'volume_size': 1} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1361312672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4928e9-5faf-455f-a753-d70f8ed61623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487b37cf06224b60bc2a1cf1be44dc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:36Z,use_quota=True,user_id='39cb7ff702f14f679ff165d4a0742969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Creating volume ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:36 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:36 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 1073741824 Jul 27 13:20:36 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cd51c-4fe0-469b-80f5-90e3992da526]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Created reservations ['f436f0e8-46c7-4575-ab75-cba4e592828e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:36 devstack cinder-volume[88202]: WARNING cinder.quota [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-803724262 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-803724262, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:20:36 devstack cinder-volume[88202]: WARNING cinder.quota [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-803724262 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-803724262, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Created reservations ['0d760167-1ddc-4765-8725-ca9d7a7c6d13', '0eef0ec1-550a-4bcf-abcf-a22b77b98ac1', 'b4fd163c-4194-4866-9e46-dcd92ba65443', '5013b897-febe-4ad5-ad43-2c247dbe4f69'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:36 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0 Jul 27 13:20:36 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:36 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:36 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:37 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0" returned: 0 in 0.439s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:37 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 1073741824" returned: 0 in 0.551s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c3717c31-2e62-489c-9910-50ed670359a2 tempest-GroupsV314Test-1913513364 None] Delete group completed successfully. Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:37 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0 Jul 27 13:20:37 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:37 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:37 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:37 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0" returned: 1 in 0.360s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_s6cn_0f0' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:20:37 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59cf2e7-0075-44f4-ab3d-03b404700523]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.260s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.590s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ba7b4b-1043-400d-8133-566f1672a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4928e9-5faf-455f-a753-d70f8ed61623', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673551e8-243d-4a81-aa34-d9dc980fe32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Creating offline snapshot 43704d69-2a39-4581-bdaf-e660c41ef7d2 of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Volume volume-ef4928e9-5faf-455f-a753-d70f8ed61623 (ef4928e9-5faf-455f-a753-d70f8ed61623): created successfully Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673551e8-243d-4a81-aa34-d9dc980fe32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Flow 'volume_create_manager' (6e0d0dac-e243-4139-8db2-b72ed2409cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d967760-a91e-481d-8a7c-4d527a413817]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f271baca-a62e-47a8-8c5e-89b433a540b9 tempest-SnapshotDependencyTests-901497158 None] Created volume successfully. Jul 27 13:20:37 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD Jul 27 13:20:37 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:37 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 Jul 27 13:20:37 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:37 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] d5827fb8-683b-418e-8e22-9911b3a6a38f was qcow2, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:37 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca Jul 27 13:20:37 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:37 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:37 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 1G Jul 27 13:20:37 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Acquiring lock "cinder-quobyte-9287c690-a042-4365-88fb-ee496e1d3207" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-9287c690-a042-4365-88fb-ee496e1d3207" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f0e021-b011-4481-aa6d-a4a5043a95af]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:38 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 1G" returned: 0 in 0.471s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:38 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:38 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:38 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:38 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:38 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.464s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:38 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207 Jul 27 13:20:38 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:38 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.494s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:38 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 is being set with open permissions: ugo+rw Jul 27 13:20:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:38 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:38 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:39 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9287c690-a042-4365-88fb-ee496e1d3207" returned: 0 in 0.299s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Lock "cinder-quobyte-9287c690-a042-4365-88fb-ee496e1d3207" released by "delete_volume" :: held 0.829s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:39 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Created reservations ['f9fc52a1-26ec-4cf0-9302-2fc8a5fc9849'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:39 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info Jul 27 13:20:39 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Created reservations ['58837107-c415-45ca-b6e4-7aa2954d1f94', '4558db49-c19b-4373-8f90-e37f7da45c05', '935603f4-3e8b-4985-ae70-a57b97e0d852', '4638e189-3fa4-4378-8096-8196a1e2f88b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:39 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:39 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:39 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:39 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info is being set with open permissions: ugo+rw Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:39 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info Jul 27 13:20:39 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:39 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-035fbd37-a770-4553-997c-6e625fa68365 tempest-GroupsV314Test-1913513364 None] Delete group completed successfully. Jul 27 13:20:39 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca" returned: 0 in 2.070s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_6roctxlqdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:20:39 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Converted 112.00 MB image at 54.07 MB/s Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:39 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 1G Jul 27 13:20:39 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:39 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.info" returned: 0 in 0.331s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.143s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Creating offline snapshot 58b75418-3f42-447e-9d0a-1ff7af7cfb1d of volume ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9971d390-9ea9-4470-869f-0afc8df57ae4 tempest-SnapshotsActionsTest-513569797 None] Create snapshot completed successfully Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6843d-c7e7-49c2-b606-1b12d3986d4a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:40 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:40 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:40 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 1G" returned: 0 in 0.384s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Downloaded image d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume a901783a-1f28-4293-a678-ae311a482bca successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f for user 7ee6e57f0f3d4822b52ce410e1beaa5e is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Marking volume a901783a-1f28-4293-a678-ae311a482bca as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Copying metadata from image d5827fb8-683b-418e-8e22-9911b3a6a38f to a901783a-1f28-4293-a678-ae311a482bca. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Creating volume glance metadata for volume a901783a-1f28-4293-a678-ae311a482bca backed by image d5827fb8-683b-418e-8e22-9911b3a6a38f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f8b812-c362-46f9-b550-f37173e5b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a901783a-1f28-4293-a678-ae311a482bca', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed3708-7ec8-4c12-b128-012d20018ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:40 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Volume volume-a901783a-1f28-4293-a678-ae311a482bca (a901783a-1f28-4293-a678-ae311a482bca): created successfully Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed3708-7ec8-4c12-b128-012d20018ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Flow 'volume_create_manager' (eb9f0f03-6519-40f9-8d52-ffd3eff406fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b43c347a-8a59-4aed-9ff4-949607496d10 tempest-VolumesExtendTest-1171792987 None] Created volume successfully. Jul 27 13:20:40 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:40 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d 1G Jul 27 13:20:40 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:40 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d 1G" returned: 0 in 0.503s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef4928e9-5faf-455f-a753-d70f8ed61623 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:40 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef4928e9-5faf-455f-a753-d70f8ed61623 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d Jul 27 13:20:40 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:41 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef4928e9-5faf-455f-a753-d70f8ed61623 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d" returned: 0 in 0.331s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:41 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d is being set with open permissions: ugo+rw Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:41 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d Jul 27 13:20:41 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:41 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d" returned: 0 in 0.275s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:41 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info Jul 27 13:20:41 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:41 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info" returned: 0 in 0.309s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:41 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info is being set with open permissions: ugo+rw Jul 27 13:20:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:41 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info Jul 27 13:20:41 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:42 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.info" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.323s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893be04-7984-458c-bd35-94155bb9499b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e0cf632d-64ad-4ccd-96c6-c87bdc6de1cf tempest-SnapshotDependencyTests-901497158 None] Create snapshot completed successfully Jul 27 13:20:42 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca Jul 27 13:20:42 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:42 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 2G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca 2G" returned: 0 in 0.099s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.496s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.972s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Creating offline snapshot 08a2c991-0212-410e-8106-8d31a0519f26 of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ffbf6a-b289-41e5-b8a5-df52024f593e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cccbfde9-b26c-4580-8f88-6091b6994627 tempest-VolumesExtendTest-1171792987 None] Extend volume completed successfully. Jul 27 13:20:42 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:42 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:43 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.445s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:43 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 1G Jul 27 13:20:43 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-a901783a-1f28-4293-a678-ae311a482bca-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Lock "cinder-a901783a-1f28-4293-a678-ae311a482bca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-quobyte-a901783a-1f28-4293-a678-ae311a482bca" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-a901783a-1f28-4293-a678-ae311a482bca" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd113cd-afce-4fe4-adde-36f35cc4aacf]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:43 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca Jul 27 13:20:43 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Flow 'volume_create_manager' (d8ec6f4b-3a33-4c2e-88e6-6429e94d278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9966459b-c5f9-41fc-96d4-ce96de2f1de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9966459b-c5f9-41fc-96d4-ce96de2f1de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fe7121-dc5f-4ad0-a1ba-30722804a3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487b37cf06224b60bc2a1cf1be44dc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58b75418-3f42-447e-9d0a-1ff7af7cfb1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:44Z,use_quota=True,user_id='39cb7ff702f14f679ff165d4a0742969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9446888c-4c88-4429-80ef-d8c46bc5a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9446888c-4c88-4429-80ef-d8c46bc5a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab03cee-17b7-4d2b-bbd3-f2f06082cac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab03cee-17b7-4d2b-bbd3-f2f06082cac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26fe7121-dc5f-4ad0-a1ba-30722804a3ec', 'volume_name': 'volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec', 'volume_size': 1, 'snapshot_id': '58b75418-3f42-447e-9d0a-1ff7af7cfb1d'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915222b0-f562-4e0d-a7c6-632905512ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915222b0-f562-4e0d-a7c6-632905512ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f65c631-2f82-4b1b-96c2-b245bf81c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:43 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Volume 26fe7121-dc5f-4ad0-a1ba-30722804a3ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec', 'volume_size': 1, 'snapshot_id': '58b75418-3f42-447e-9d0a-1ff7af7cfb1d'} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:43 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 1G" returned: 0 in 0.664s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:43 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:43 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 Jul 27 13:20:43 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:43 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca Jul 27 13:20:43 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:44 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a901783a-1f28-4293-a678-ae311a482bca" returned: 0 in 0.273s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-a901783a-1f28-4293-a678-ae311a482bca" released by "delete_volume" :: held 0.811s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:44 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26" returned: 0 in 0.336s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:44 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 is being set with open permissions: ugo+rw Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:44 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 Jul 27 13:20:44 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Created reservations ['e9886f93-4fbb-40b6-bfc3-afa9f1f32bcc', '4fc51046-0aeb-44aa-9689-85ed60e9e1b2', '336b7632-2189-4bc2-b0ae-97b7137a5d68', '07ec3333-5b7d-42e1-aeae-d5c2994b4565'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:44 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:44 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:44 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26" returned: 0 in 0.313s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.733s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-quobyte-58b75418-3f42-447e-9d0a-1ff7af7cfb1d-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-58b75418-3f42-447e-9d0a-1ff7af7cfb1d-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Creating volume 26fe7121-dc5f-4ad0-a1ba-30722804a3ec from snapshot 58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-quobyte-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d4f5f5e4-6443-467d-82f3-4f5d54cb484a tempest-SnapshotsActionsTest-513569797 None] Create snapshot completed successfully Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] snapshot: 58b75418-3f42-447e-9d0a-1ff7af7cfb1d, volume: 26fe7121-dc5f-4ad0-a1ba-30722804a3ec, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:44 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5418032d-8a26-4720-a4ce-71093a81f9ac]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Deleted volume successfully. Jul 27 13:20:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b094936-0e08-4161-a64c-e487a28325cd tempest-VolumesExtendTest-1171792987 None] Lock "cinder-a901783a-1f28-4293-a678-ae311a482bca-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:44 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d Jul 27 13:20:44 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-08a2c991-0212-410e-8106-8d31a0519f26-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-08a2c991-0212-410e-8106-8d31a0519f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-08a2c991-0212-410e-8106-8d31a0519f26" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Flow 'volume_create_manager' (1055cf7c-1a1e-4cfd-b119-84a43d4877f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea0d213-5c6d-4f1d-b477-698092614674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-08a2c991-0212-410e-8106-8d31a0519f26" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Deleting offline snapshot 08a2c991-0212-410e-8106-8d31a0519f26 of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:20:45 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] snapshot_file for this snap is: volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[523469c2-0818-4c3a-8e02-452e71a644eb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d" returned: 0 in 0.510s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef4928e9-5faf-455f-a753-d70f8ed61623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea0d213-5c6d-4f1d-b477-698092614674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-629618998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333cb93c-73a6-457a-ac3e-1a24b2a3d527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820984b3377f4ed193c6bfb5c1207c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:45Z,use_quota=True,user_id='7ee6e57f0f3d4822b52ce410e1beaa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a84eb79-6094-499a-8c41-b959841b5254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a84eb79-6094-499a-8c41-b959841b5254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1d3ecf-d6b6-4359-970e-68a36058a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1d3ecf-d6b6-4359-970e-68a36058a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333cb93c-73a6-457a-ac3e-1a24b2a3d527', 'volume_name': 'volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df3bd9-7aa0-4ee6-bef6-ff59e2a28923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df3bd9-7aa0-4ee6-bef6-ff59e2a28923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f200968b-0471-49a5-905c-80581aa648ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:45 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Volume 333cb93c-73a6-457a-ac3e-1a24b2a3d527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527', 'volume_size': 1} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a01d0e-347d-44c4-b26c-11e3e01fb87e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f860cc62-2455-4502-958a-abbed1fc673f tempest-GroupsV320Test-677441594 None] Group tempest-GroupsV320Test-Group-897820260: creating Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f860cc62-2455-4502-958a-abbed1fc673f tempest-GroupsV320Test-677441594 None] Group tempest-GroupsV320Test-Group-897820260: created successfully Jul 27 13:20:45 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 Jul 27 13:20:45 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f860cc62-2455-4502-958a-abbed1fc673f tempest-GroupsV320Test-677441594 None] Create group completed successfully. Jul 27 13:20:45 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:45 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:45 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26" returned: 0 in 0.347s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f2dd0d-3088-4a47-b269-9621bdbff4da]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:45 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.383s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:20:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:45 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec Jul 27 13:20:45 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:45 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:45 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:46 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.384s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:46 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 Jul 27 13:20:46 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:46 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26" returned: 0 in 0.658s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:46 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26 Jul 27 13:20:46 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Created reservations ['b1344c12-e7c2-4215-854c-3a8939c1e2a1'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:47 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.08a2c991-0212-410e-8106-8d31a0519f26" returned: 0 in 0.621s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:47 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:47 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-08a2c991-0212-410e-8106-8d31a0519f26" released by "_delete_snapshot" :: held 2.154s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" released by "delete_snapshot" :: held 2.230s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Created reservations ['4352d235-fb19-4457-9112-fcfabd66c669', 'c1da19c2-0af9-449c-b50f-4293c5c7e049', '78b569db-29e7-47d5-be8f-1a916c96be34', 'aadc843c-910a-41ab-99fa-bdc133f9743b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Delete snapshot completed successfully. Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2bc17cbb-b78d-4811-b84b-79f762739f36 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-08a2c991-0212-410e-8106-8d31a0519f26-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:47 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.546s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:47 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-88e223fc-e634-4825-83d7-8af772c6f87c tempest-GroupsV320Test-677441594 None] Delete group completed successfully. Jul 27 13:20:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:51 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" returned: 0 in 5.262s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f65388-3d2f-42b9-bfcb-760177cb7d4b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:51 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:51 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:51 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:20:51 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Converted 1024.00 MB image at 194.57 MB/s Jul 27 13:20:51 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec is being set with open permissions: ugo+rw Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:51 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec Jul 27 13:20:51 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:51 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" returned: 0 in 0.250s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" released by "_copy_volume_from_snapshot" :: held 7.164s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-58b75418-3f42-447e-9d0a-1ff7af7cfb1d-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" released by "_create_volume_from_snapshot" :: held 7.227s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.264s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.534s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-629618998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333cb93c-73a6-457a-ac3e-1a24b2a3d527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820984b3377f4ed193c6bfb5c1207c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:20:45Z,use_quota=True,user_id='7ee6e57f0f3d4822b52ce410e1beaa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Creating volume 333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:20:51 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:51 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 1073741824 Jul 27 13:20:51 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f65c631-2f82-4b1b-96c2-b245bf81c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec', 'volume_size': 1, 'snapshot_id': '58b75418-3f42-447e-9d0a-1ff7af7cfb1d'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31a6a7e-0966-40ec-b7d2-301f0273ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Volume volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec (26fe7121-dc5f-4ad0-a1ba-30722804a3ec): created successfully Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31a6a7e-0966-40ec-b7d2-301f0273ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Flow 'volume_create_manager' (d8ec6f4b-3a33-4c2e-88e6-6429e94d278b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2d976e17-f890-4081-912c-f679933d172b tempest-SnapshotDependencyTests-901497158 None] Created volume successfully. Jul 27 13:20:52 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 1073741824" returned: 0 in 0.470s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:52 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 Jul 27 13:20:52 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-58b75418-3f42-447e-9d0a-1ff7af7cfb1d-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-58b75418-3f42-447e-9d0a-1ff7af7cfb1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-quobyte-ef4928e9-5faf-455f-a753-d70f8ed61623" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-ef4928e9-5faf-455f-a753-d70f8ed61623" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-quobyte-58b75418-3f42-447e-9d0a-1ff7af7cfb1d" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-58b75418-3f42-447e-9d0a-1ff7af7cfb1d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Deleting offline snapshot 58b75418-3f42-447e-9d0a-1ff7af7cfb1d of volume ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:20:52 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] snapshot_file for this snap is: volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527" returned: 0 in 0.355s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.530s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14474fe-15b1-4ce4-8c4a-b46c02b0667e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Creating offline snapshot 58272134-00a1-49cc-af00-a5cbe45e6b2c of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f200968b-0471-49a5-905c-80581aa648ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f154b20e-152a-4aae-af4c-e6540ef6aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[63306995-caba-4e35-a011-4ca453d21820]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Volume volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 (333cb93c-73a6-457a-ac3e-1a24b2a3d527): created successfully Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f154b20e-152a-4aae-af4c-e6540ef6aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:20:52 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d Jul 27 13:20:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Flow 'volume_create_manager' (1055cf7c-1a1e-4cfd-b119-84a43d4877f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:20:52 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0962de0d-aada-429b-8bc6-6be1074ee177 tempest-VolumesExtendTest-1171792987 None] Created volume successfully. Jul 27 13:20:53 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:53 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:53 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef4928e9-5faf-455f-a753-d70f8ed61623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a99ec62-23f8-457b-b60d-6448ad9b5726]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:53 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:53 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c 1G Jul 27 13:20:53 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:53 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:53 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:53 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:53 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d Jul 27 13:20:53 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:53 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c 1G" returned: 0 in 0.499s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:53 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c Jul 27 13:20:53 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:53 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:54 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d Jul 27 13:20:54 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:54 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c" returned: 0 in 0.390s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:54 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c is being set with open permissions: ugo+rw Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:54 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c Jul 27 13:20:54 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:54 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623.58b75418-3f42-447e-9d0a-1ff7af7cfb1d" returned: 0 in 0.310s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-58b75418-3f42-447e-9d0a-1ff7af7cfb1d" released by "_delete_snapshot" :: held 1.609s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-ef4928e9-5faf-455f-a753-d70f8ed61623" released by "delete_snapshot" :: held 1.640s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Created reservations ['23706397-8cc7-4dd2-9aed-56f6524e1dce', 'dd665c71-0316-46e1-8831-7745737422e0', '91bd1742-b243-4dca-9d21-9bdc68e93251', '8375bba9-8f00-4017-aa5e-b6a799da68da'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Delete snapshot completed successfully. Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8f12a234-4e43-4690-9fcf-af5aaf3b2594 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-58b75418-3f42-447e-9d0a-1ff7af7cfb1d-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:54 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.274s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Creating offline snapshot bfe84739-91b7-4792-90bf-be7c79a48c2c of volume 333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c170f96c-dc3a-4a3a-b502-508597443b83 tempest-SnapshotsActionsTest-513569797 None] Create snapshot completed successfully Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c481c63e-90ff-4f37-bdbf-1958daac50e0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:54 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 Jul 27 13:20:54 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-ef4928e9-5faf-455f-a753-d70f8ed61623-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-ef4928e9-5faf-455f-a753-d70f8ed61623-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-quobyte-ef4928e9-5faf-455f-a753-d70f8ed61623" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-ef4928e9-5faf-455f-a753-d70f8ed61623" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[652fd26b-3016-4656-ba96-e896a97c139b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:54 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:55 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c 1G Jul 27 13:20:55 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:55 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:55 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:55 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.385s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:55 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623 Jul 27 13:20:55 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:55 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c 1G" returned: 0 in 0.503s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:55 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c Jul 27 13:20:55 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-58272134-00a1-49cc-af00-a5cbe45e6b2c-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-58272134-00a1-49cc-af00-a5cbe45e6b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-58272134-00a1-49cc-af00-a5cbe45e6b2c" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-58272134-00a1-49cc-af00-a5cbe45e6b2c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Deleting offline snapshot 58272134-00a1-49cc-af00-a5cbe45e6b2c of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] snapshot_file for this snap is: volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a3d58-a537-4851-a50c-875eb4981a23]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:55 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ef4928e9-5faf-455f-a753-d70f8ed61623" returned: 0 in 0.364s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-ef4928e9-5faf-455f-a753-d70f8ed61623" released by "delete_volume" :: held 0.812s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Created reservations ['47dd39ab-a986-4ab1-b0d3-6a4c3ee759ea', '1b6581e7-4dde-4c9c-b6c1-86c1fe3f104c', '09665bc2-c42a-405c-a94d-159a0960ccb6', '3eaeeedb-7404-43f3-b14a-77ae187cb4c8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:55 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c Jul 27 13:20:55 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:55 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:55 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c is being set with open permissions: ugo+rw Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:55 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c Jul 27 13:20:55 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:55 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:55 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-26fe7121-dc5f-4ad0-a1ba-30722804a3ec-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-26fe7121-dc5f-4ad0-a1ba-30722804a3ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:56 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c" returned: 0 in 0.485s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "cinder-quobyte-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[143c6001-76c9-4266-97fe-291408fcca5f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:56 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c" returned: 0 in 0.402s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" acquired by "delete_volume" :: waited 0.054s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:56 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.409s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f62f6e-3e4a-4529-ae54-bb3195a0db10]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Deleted volume successfully. Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:56 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:56 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e3c3b473-b8b6-42e1-9c7f-30f1b0d329bc tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-ef4928e9-5faf-455f-a753-d70f8ed61623-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:56 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info Jul 27 13:20:56 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:56 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec Jul 27 13:20:56 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:56 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info" returned: 0 in 0.349s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:56 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info is being set with open permissions: ugo+rw Jul 27 13:20:56 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.522s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:56 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info Jul 27 13:20:56 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:56 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" returned: 0 in 0.460s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:56 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c Jul 27 13:20:56 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:56 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec Jul 27 13:20:56 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:57 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.info" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e82ce8fb-7043-4fdd-a49d-bcfdd9b19c1c tempest-VolumesExtendTest-1171792987 None] Create snapshot completed successfully Jul 27 13:20:57 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" returned: 0 in 0.312s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-quobyte-26fe7121-dc5f-4ad0-a1ba-30722804a3ec" released by "delete_volume" :: held 0.852s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Created reservations ['0933f373-daed-4e0b-ae04-8d510c636227', '606f9d06-641b-4bd6-8b8c-19b3910753b5', '6a78503d-0a98-4c14-a332-332ccc069304', '2c63ea74-d034-49d6-9085-6d2deca781b5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:20:57 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c" returned: 0 in 0.520s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:57 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:20:57 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:57 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c Jul 27 13:20:57 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:57 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:20:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Deleted volume successfully. Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-657efc9b-8b93-42d0-afc9-2a055620e6c6 tempest-SnapshotDependencyTests-901497158 None] Lock "cinder-26fe7121-dc5f-4ad0-a1ba-30722804a3ec-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ab821-3323-4cce-b1b5-1730ab0ba477]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:57 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.58272134-00a1-49cc-af00-a5cbe45e6b2c" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-58272134-00a1-49cc-af00-a5cbe45e6b2c" released by "_delete_snapshot" :: held 2.024s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" released by "delete_snapshot" :: held 2.053s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:57 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 Jul 27 13:20:57 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Created reservations ['ad2178a6-43d8-4934-afe7-4d208b9dd945', '87083afd-88b2-4636-9fae-8916ad306fe2', '327afab8-8870-44a0-b04f-4bfc33ccec28', '108632cd-b1c4-4970-b72b-7c4786ed6bed'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:20:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Delete snapshot completed successfully. Jul 27 13:20:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8469b593-495b-4164-b379-a00dcff31307 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-58272134-00a1-49cc-af00-a5cbe45e6b2c-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:20:58 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c 2G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c 2G" returned: 0 in 0.140s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.592s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:20:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a7785136-c6a5-4414-be9d-4cbee0083fef tempest-VolumesExtendTest-1171792987 None] Extend volume completed successfully. Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-bfe84739-91b7-4792-90bf-be7c79a48c2c-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Lock "cinder-bfe84739-91b7-4792-90bf-be7c79a48c2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-quobyte-333cb93c-73a6-457a-ac3e-1a24b2a3d527" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-333cb93c-73a6-457a-ac3e-1a24b2a3d527" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-quobyte-bfe84739-91b7-4792-90bf-be7c79a48c2c" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-bfe84739-91b7-4792-90bf-be7c79a48c2c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Deleting offline snapshot bfe84739-91b7-4792-90bf-be7c79a48c2c of volume 333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] snapshot_file for this snap is: volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f88150f-3646-49ac-be08-3f5600a17d48]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:59 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c Jul 27 13:20:59 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Creating offline snapshot 6a4d5b35-bbed-4009-b3c3-e6016ee270d7 of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef2b1b9-2adc-4a33-a353-1e64424bb4eb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:59 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:20:59 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:59 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c" returned: 0 in 0.517s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b856f44-eae5-44d7-85da-9ae3fe2d9ebb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:59 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 Jul 27 13:20:59 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:59 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.439s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:20:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:20:59 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 1G Jul 27 13:20:59 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:20:59 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527" returned: 0 in 0.439s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:00 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c Jul 27 13:21:00 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:00 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 1G" returned: 0 in 0.576s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:00 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 Jul 27 13:21:00 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:00 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c" returned: 0 in 0.489s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:00 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c Jul 27 13:21:00 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:00 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:00 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 is being set with open permissions: ugo+rw Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:00 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 Jul 27 13:21:00 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:00 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527.bfe84739-91b7-4792-90bf-be7c79a48c2c" returned: 0 in 0.386s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-bfe84739-91b7-4792-90bf-be7c79a48c2c" released by "_delete_snapshot" :: held 2.011s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-333cb93c-73a6-457a-ac3e-1a24b2a3d527" released by "delete_snapshot" :: held 2.051s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:01 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7" returned: 0 in 0.318s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-739796e9-1f4e-4df2-99d5-cd68c0c9d9c8 tempest-SnapshotsActionsTest-513569797 None] Create snapshot completed successfully Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Created reservations ['6ee7bd4e-c073-48cd-825a-4837fc25d1db', '1d421df5-d586-4fb9-b8f9-1ec3b148afa0', '35cfc158-b22b-47ab-b891-70ff6a012ebe', '71721799-4d58-4178-915a-743ef1b424c7'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Delete snapshot completed successfully. Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cb65f7e4-3115-4b18-ac82-e0d31bd3e755 tempest-VolumesExtendTest-1171792987 None] Lock "cinder-bfe84739-91b7-4792-90bf-be7c79a48c2c-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-6a4d5b35-bbed-4009-b3c3-e6016ee270d7-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-6a4d5b35-bbed-4009-b3c3-e6016ee270d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-6a4d5b35-bbed-4009-b3c3-e6016ee270d7" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-6a4d5b35-bbed-4009-b3c3-e6016ee270d7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Deleting offline snapshot 6a4d5b35-bbed-4009-b3c3-e6016ee270d7 of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] snapshot_file for this snap is: volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8a4967-81a5-4af8-9a8d-bdfdb7ccffe9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:01 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 Jul 27 13:21:01 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:02 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d539598-9624-4694-bad8-87fd461aa207]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-333cb93c-73a6-457a-ac3e-1a24b2a3d527-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Lock "cinder-333cb93c-73a6-457a-ac3e-1a24b2a3d527-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:02 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:21:02 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Acquiring lock "cinder-quobyte-333cb93c-73a6-457a-ac3e-1a24b2a3d527" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-333cb93c-73a6-457a-ac3e-1a24b2a3d527" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4412b523-12b1-43af-a502-ef64bd716157]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:02 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 Jul 27 13:21:02 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:02 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.562s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:02 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 Jul 27 13:21:02 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:02 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527" returned: 0 in 0.490s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:02 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527 Jul 27 13:21:02 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Flow 'volume_create_manager' (83a28042-2c4f-497a-b1c1-7e899fffa744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508528d9-258f-4d21-981b-04ff8780bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508528d9-258f-4d21-981b-04ff8780bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2100634117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69b027b-4d81-4d7b-91f4-0e8d4aa3be80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6d9171cbad4b3aae9dad174da98d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:03Z,use_quota=True,user_id='410ed6d241a94255872e7be59b42c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d11ce-f218-43e5-9df9-18d0b2a0821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d11ce-f218-43e5-9df9-18d0b2a0821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:03 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8901fc28-1e9b-4e7b-a315-180f665c140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:03 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8901fc28-1e9b-4e7b-a315-180f665c140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69b027b-4d81-4d7b-91f4-0e8d4aa3be80', 'volume_name': 'volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c53f2f2-d807-46e3-8205-024fca57b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c53f2f2-d807-46e3-8205-024fca57b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9aeb60a-bcc8-46c9-ae2a-ac12c81e0a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Volume f69b027b-4d81-4d7b-91f4-0e8d4aa3be80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80', 'volume_size': 1} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2100634117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69b027b-4d81-4d7b-91f4-0e8d4aa3be80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6d9171cbad4b3aae9dad174da98d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:03Z,use_quota=True,user_id='410ed6d241a94255872e7be59b42c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Creating volume f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:03 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7" returned: 0 in 0.541s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-333cb93c-73a6-457a-ac3e-1a24b2a3d527" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:03 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 1073741824 Jul 27 13:21:03 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:03 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7 Jul 27 13:21:03 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Lock "cinder-quobyte-333cb93c-73a6-457a-ac3e-1a24b2a3d527" released by "delete_volume" :: held 0.952s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Created reservations ['0f7a53c6-e2c6-41c7-8fc1-903fd0172b25', 'f6e63011-5025-4796-bd6c-06349981705b', 'b6f4e04e-5c0b-4881-bcfb-f1056f924a49', 'c5a6c7a4-b2ac-4695-8eff-05f6d0dad88d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:03 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:03 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:03 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.6a4d5b35-bbed-4009-b3c3-e6016ee270d7" returned: 0 in 0.390s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-6a4d5b35-bbed-4009-b3c3-e6016ee270d7" released by "_delete_snapshot" :: held 2.062s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" released by "delete_snapshot" :: held 2.098s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Created reservations ['3969f7b8-155c-459a-9528-126d731b798f', '18424f04-f3c1-43e7-bddf-c52aa8da2b3c', '17437b56-16a6-4da2-bba9-f0b9ccdc8021', '4a9849d9-b31e-4036-aa02-7fc6db2f031e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Delete snapshot completed successfully. Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-232edb39-1701-43ad-9d27-893217bbbb85 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-6a4d5b35-bbed-4009-b3c3-e6016ee270d7-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:03 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.380s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Deleted volume successfully. Jul 27 13:21:03 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-91581d38-9e7a-4f68-a694-ee0876b292ab tempest-VolumesExtendTest-1171792987 None] Lock "cinder-333cb93c-73a6-457a-ac3e-1a24b2a3d527-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 1073741824" returned: 0 in 0.656s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:03 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 Jul 27 13:21:03 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:04 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80" returned: 0 in 0.253s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9aeb60a-bcc8-46c9-ae2a-ac12c81e0a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f265f5a-3b97-4647-b77b-d7223dd84959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Volume volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 (f69b027b-4d81-4d7b-91f4-0e8d4aa3be80): created successfully Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f265f5a-3b97-4647-b77b-d7223dd84959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Flow 'volume_create_manager' (83a28042-2c4f-497a-b1c1-7e899fffa744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-05031037-d460-44e2-9ac2-77acf946ce04 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Created volume successfully. Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Creating offline snapshot aa4f8ab9-317c-4cb5-a3dd-327d138763be of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eab420-8990-4474-b3ab-c9bb97ecc4f0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "cinder-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "cinder-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:05 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:21:05 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "cinder-quobyte-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "cinder-quobyte-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b534adaa-840c-44f7-873b-dd983e98c590]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:05 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 Jul 27 13:21:05 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:05 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.572s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:05 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be 1G Jul 27 13:21:05 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:05 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80" returned: 0 in 0.563s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:06 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80 Jul 27 13:21:06 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:06 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80" returned: 0 in 0.317s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "cinder-quobyte-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80" released by "delete_volume" :: held 0.945s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Created reservations ['3da72209-e843-4890-9e13-2f63d7f7b56a', '8fe91da5-a1ef-4832-9145-ddd3361acf43', 'feae9935-3202-40d0-809a-0f63618b19cd', '8560588b-6536-441e-a856-d9ae08bfad96'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:06 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be 1G" returned: 0 in 0.759s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:06 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be Jul 27 13:21:06 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:06 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:06 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:06 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.311s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Deleted volume successfully. Jul 27 13:21:06 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:06 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be is being set with open permissions: ugo+rw Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:06 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be Jul 27 13:21:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-854fb8f0-2293-46c6-b85a-014054cffac3 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "cinder-f69b027b-4d81-4d7b-91f4-0e8d4aa3be80-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:06 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:07 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be" returned: 0 in 0.332s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-02291973-f745-4e6c-8527-9b4737e44ed9 tempest-SnapshotsActionsTest-513569797 None] Create snapshot completed successfully Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Flow 'volume_create_manager' (ee9fffcb-166a-4d63-81f6-a2c3adad96a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d783b122-ac4b-42b1-87cc-6d208f565686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d783b122-ac4b-42b1-87cc-6d208f565686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-157389465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03ba2fd-806a-4993-9324-dde6752949c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6d9171cbad4b3aae9dad174da98d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:08Z,use_quota=True,user_id='410ed6d241a94255872e7be59b42c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72f037a-dd7e-45a3-a7c3-dc6737b929b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72f037a-dd7e-45a3-a7c3-dc6737b929b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f604f30-9eb6-43d8-89fa-4b33535fecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f604f30-9eb6-43d8-89fa-4b33535fecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03ba2fd-806a-4993-9324-dde6752949c2', 'volume_name': 'volume-c03ba2fd-806a-4993-9324-dde6752949c2', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d7c669-883a-4d66-9ecd-c562fd3bc6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d7c669-883a-4d66-9ecd-c562fd3bc6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5970fdf7-4825-4e7b-a667-9d9f239c6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Volume c03ba2fd-806a-4993-9324-dde6752949c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03ba2fd-806a-4993-9324-dde6752949c2', 'volume_size': 1} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-157389465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03ba2fd-806a-4993-9324-dde6752949c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6d9171cbad4b3aae9dad174da98d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:08Z,use_quota=True,user_id='410ed6d241a94255872e7be59b42c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Creating volume c03ba2fd-806a-4993-9324-dde6752949c2 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:08 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:08 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 1073741824 Jul 27 13:21:08 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (343c5354-7d5e-46e1-b838-15828c07d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce2b99e-0f9d-49c1-b19e-97b2552fdec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-aa4f8ab9-317c-4cb5-a3dd-327d138763be-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce2b99e-0f9d-49c1-b19e-97b2552fdec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-929132814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499697cb-b11d-4c62-b4ff-43336bf163ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:08Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ac29e6-b20f-41e1-971e-5a2f47d57b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ac29e6-b20f-41e1-971e-5a2f47d57b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bc1231-a39b-48cd-a85f-e7f3a542fd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bc1231-a39b-48cd-a85f-e7f3a542fd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499697cb-b11d-4c62-b4ff-43336bf163ae', 'volume_name': 'volume-499697cb-b11d-4c62-b4ff-43336bf163ae', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d229247-9ca7-4a6f-a1d1-8545b27fba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d229247-9ca7-4a6f-a1d1-8545b27fba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b292c13c-4889-4aa3-87b8-6b2f0a4ae208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Volume 499697cb-b11d-4c62-b4ff-43336bf163ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499697cb-b11d-4c62-b4ff-43336bf163ae', 'volume_size': 1} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-aa4f8ab9-317c-4cb5-a3dd-327d138763be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Acquiring lock "cinder-quobyte-aa4f8ab9-317c-4cb5-a3dd-327d138763be" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-aa4f8ab9-317c-4cb5-a3dd-327d138763be" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Deleting offline snapshot aa4f8ab9-317c-4cb5-a3dd-327d138763be of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] snapshot_file for this snap is: volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[455462fc-cd99-499a-8a8d-0befa5f0efc6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:08 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be Jul 27 13:21:08 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:08 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 1073741824" returned: 0 in 0.585s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:08 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 Jul 27 13:21:08 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:08 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be" returned: 0 in 0.420s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae04bbd2-f5db-413a-bac7-95f0f6ec1b0b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:09 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:21:09 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:09 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2" returned: 0 in 0.273s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-929132814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499697cb-b11d-4c62-b4ff-43336bf163ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:08Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Creating volume 499697cb-b11d-4c62-b4ff-43336bf163ae {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:09 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5970fdf7-4825-4e7b-a667-9d9f239c6154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03ba2fd-806a-4993-9324-dde6752949c2', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4aa3d5-c132-467e-a16e-7a562950ed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:09 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae 1073741824 Jul 27 13:21:09 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:09 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Volume volume-c03ba2fd-806a-4993-9324-dde6752949c2 (c03ba2fd-806a-4993-9324-dde6752949c2): created successfully Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4aa3d5-c132-467e-a16e-7a562950ed3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Flow 'volume_create_manager' (ee9fffcb-166a-4d63-81f6-a2c3adad96a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a0d94669-d6de-4e1f-a723-fa9eaa6fe084 tempest-VolumeQuotasAdminTestJSON-2120330269 None] Created volume successfully. Jul 27 13:21:09 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:09 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be Jul 27 13:21:09 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:09 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae 1073741824" returned: 0 in 0.510s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:09 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae Jul 27 13:21:09 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:09 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be" returned: 0 in 0.420s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:09 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be Jul 27 13:21:09 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:10 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae" returned: 0 in 0.249s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b292c13c-4889-4aa3-87b8-6b2f0a4ae208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499697cb-b11d-4c62-b4ff-43336bf163ae', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4588c83b-7bc3-49f7-854e-2de6ce26312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Volume volume-499697cb-b11d-4c62-b4ff-43336bf163ae (499697cb-b11d-4c62-b4ff-43336bf163ae): created successfully Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4588c83b-7bc3-49f7-854e-2de6ce26312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (343c5354-7d5e-46e1-b838-15828c07d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4a594d3d-a1d1-406c-ae80-7da9c6f745d6 tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:10 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.aa4f8ab9-317c-4cb5-a3dd-327d138763be" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-aa4f8ab9-317c-4cb5-a3dd-327d138763be" released by "_delete_snapshot" :: held 1.619s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" released by "delete_snapshot" :: held 1.647s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Created reservations ['a5e0c8bd-22b2-4fac-a412-9acfa9c46fab', '5d0a25ba-6a31-4c66-89f7-290bf3a1013f', '343b3831-07d2-4ded-b2ad-9ee5be1adc6a', 'ee68d0d8-0823-498a-9976-174a8c878596'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Delete snapshot completed successfully. Jul 27 13:21:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4332f9f9-f43a-4dfd-a893-eaaf88171f78 tempest-SnapshotsActionsTest-1468711827 None] Lock "cinder-aa4f8ab9-317c-4cb5-a3dd-327d138763be-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-978f493e-9583-460b-94f5-c6142240556f tempest-VolumeQuotasAdminTestJSON-539881080 None] Transfer volume completed successfully. Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (a3540fc1-8a55-4c89-b04a-cf9a39205aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7b8ac2-89d4-42f2-bef5-348b2b57cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7b8ac2-89d4-42f2-bef5-348b2b57cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1595933218',display_name='tempest-VolumesGetTest-Volume-1781032619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3bee0f-eb15-4414-8495-35020c9f14c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:11Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd516b4e-9de8-4cfc-809c-04fd562acfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd516b4e-9de8-4cfc-809c-04fd562acfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a68790-32c6-4d79-9081-bbe4ce4d53f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a68790-32c6-4d79-9081-bbe4ce4d53f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3bee0f-eb15-4414-8495-35020c9f14c8', 'volume_name': 'volume-8b3bee0f-eb15-4414-8495-35020c9f14c8', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94102e1-ee0f-4ec8-93c1-46a6f0fd4133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94102e1-ee0f-4ec8-93c1-46a6f0fd4133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459729fd-f163-4e1d-9c2e-b6aed4db2f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:11 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Volume 8b3bee0f-eb15-4414-8495-35020c9f14c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3bee0f-eb15-4414-8495-35020c9f14c8', 'volume_size': 1} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1595933218',display_name='tempest-VolumesGetTest-Volume-1781032619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3bee0f-eb15-4414-8495-35020c9f14c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:11Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Creating volume 8b3bee0f-eb15-4414-8495-35020c9f14c8 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:11 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:11 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 1073741824 Jul 27 13:21:11 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Acquiring lock "cinder-c03ba2fd-806a-4993-9324-dde6752949c2-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Lock "cinder-c03ba2fd-806a-4993-9324-dde6752949c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "cinder-43704d69-2a39-4581-bdaf-e660c41ef7d2-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-43704d69-2a39-4581-bdaf-e660c41ef7d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "cinder-quobyte-43704d69-2a39-4581-bdaf-e660c41ef7d2" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Acquiring lock "cinder-quobyte-c03ba2fd-806a-4993-9324-dde6752949c2" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-quobyte-43704d69-2a39-4581-bdaf-e660c41ef7d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Deleting offline snapshot 43704d69-2a39-4581-bdaf-e660c41ef7d2 of volume b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] snapshot_file for this snap is: volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Lock "cinder-quobyte-c03ba2fd-806a-4993-9324-dde6752949c2" acquired by "delete_volume" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[38543cb8-25b5-4f18-a359-43f29668083a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e2cd5-211a-48f8-85b7-7c37ec2f7bb2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:11 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:21:11 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:11 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 Jul 27 13:21:11 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:11 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 1073741824" returned: 0 in 0.491s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:11 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 Jul 27 13:21:11 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:12 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.412s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:12 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2" returned: 0 in 0.422s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b41f78-9baf-444c-8cde-28c2b0138738]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:12 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2 Jul 27 13:21:12 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:12 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 Jul 27 13:21:12 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:12 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8" returned: 0 in 0.308s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459729fd-f163-4e1d-9c2e-b6aed4db2f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3bee0f-eb15-4414-8495-35020c9f14c8', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08774c1-c8a1-471d-9559-e7f7d00ffed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:12 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Volume volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 (8b3bee0f-eb15-4414-8495-35020c9f14c8): created successfully Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08774c1-c8a1-471d-9559-e7f7d00ffed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (a3540fc1-8a55-4c89-b04a-cf9a39205aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a0b14a80-559f-45a4-b793-2b7c4e546c0b tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:12 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c03ba2fd-806a-4993-9324-dde6752949c2" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Lock "cinder-quobyte-c03ba2fd-806a-4993-9324-dde6752949c2" released by "delete_volume" :: held 0.727s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Created reservations ['320db890-405d-4130-a12c-6b53810c3820', '537d847f-7781-486c-ae49-31fd748298c9', '604fafbe-89b0-4953-a82d-542b03f0be81', '4b1e1a62-cd47-4fc2-b121-d14414fe666d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:12 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" returned: 0 in 0.396s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:12 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:12 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:12 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:21:12 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:12 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Deleted volume successfully. Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-522ad929-ab52-456c-a2e8-d1bf2d0caad7 tempest-VolumeQuotasAdminTestJSON-1651053027 None] Lock "cinder-c03ba2fd-806a-4993-9324-dde6752949c2-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:12 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:12 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2 Jul 27 13:21:12 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:13 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3.43704d69-2a39-4581-bdaf-e660c41ef7d2" returned: 0 in 0.259s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-quobyte-43704d69-2a39-4581-bdaf-e660c41ef7d2" released by "_delete_snapshot" :: held 1.582s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" released by "delete_snapshot" :: held 1.605s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Created reservations ['c9f7d394-93ec-4c5f-9332-86b1c37dbfba', 'd17b06db-225e-48dc-ab2f-a478b6c0c144', 'de3e044d-f90b-4610-bad6-2aed7420e99d', 'ae6b7698-9371-46e2-8658-13bdaddb7b05'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Delete snapshot completed successfully. Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9f4c74e3-aaca-4afb-8ae2-4092a7b4710d tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-43704d69-2a39-4581-bdaf-e660c41ef7d2-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-8b3bee0f-eb15-4414-8495-35020c9f14c8-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Lock "cinder-8b3bee0f-eb15-4414-8495-35020c9f14c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-8b3bee0f-eb15-4414-8495-35020c9f14c8" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-8b3bee0f-eb15-4414-8495-35020c9f14c8" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[10de273b-5e9c-452f-b1af-9d11881719a8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:13 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 Jul 27 13:21:13 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "cinder-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[849725e8-f769-41a7-ada0-6fbf8f334688]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:14 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 Jul 27 13:21:14 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:14 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8" returned: 0 in 0.449s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:14 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8 Jul 27 13:21:14 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:14 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" returned: 0 in 0.402s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:14 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3 Jul 27 13:21:14 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:14 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8b3bee0f-eb15-4414-8495-35020c9f14c8" returned: 0 in 0.290s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-8b3bee0f-eb15-4414-8495-35020c9f14c8" released by "delete_volume" :: held 0.792s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Created reservations ['8aeda56b-9af4-448f-b2f0-4c85ba67e413', '3c4fee6e-a799-4df4-89fc-8ade72159869', 'c0b6e3bd-b9b4-41d8-bb1d-bc384a7e043a', '2cc6164b-932e-428e-84f6-6d2e11cc4b9c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:14 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:14 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:14 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" returned: 0 in 0.343s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-quobyte-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3" released by "delete_volume" :: held 0.839s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Created reservations ['e0f16ac4-3c0e-4f14-8de7-932e8558bf79', 'c95dcd8d-f47b-47f0-8a70-cbb17255c35c', '3744c7e0-d360-4184-a60a-627908dcaa44', '2da790c7-b1fb-4a40-8bf9-8a0852f00361'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-499697cb-b11d-4c62-b4ff-43336bf163ae-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Lock "cinder-499697cb-b11d-4c62-b4ff-43336bf163ae-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-499697cb-b11d-4c62-b4ff-43336bf163ae" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:14 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:14 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-499697cb-b11d-4c62-b4ff-43336bf163ae" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8002c607-ce2e-4348-9cbb-50099c255299]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:15 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.426s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0424a1f0-c288-4598-b55e-dc7256314fda tempest-VolumesGetTest-911511621 None] Lock "cinder-8b3bee0f-eb15-4414-8495-35020c9f14c8-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:15 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae Jul 27 13:21:15 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:15 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Deleted volume successfully. Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e28db39-2aa2-4be6-939d-ce826752d86a tempest-SnapshotsActionsTest-513569797 None] Lock "cinder-b7f43b18-cbb8-4ea3-b897-b268ea97b7d3-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:15 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae" returned: 0 in 0.486s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:15 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae Jul 27 13:21:15 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:15 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-499697cb-b11d-4c62-b4ff-43336bf163ae" returned: 0 in 0.288s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-499697cb-b11d-4c62-b4ff-43336bf163ae" released by "delete_volume" :: held 0.829s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Created reservations ['42814ae4-ac32-4fa6-ad4e-5caf11a3eb37', '8602414e-4aa1-479f-9103-a76167bcc5d4', '01771dea-a48c-4db2-ad06-c56f9bca5a61', 'dc9010aa-f20b-4024-a6e4-46dc399a1ef9'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:15 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:15 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:16 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.354s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-07a51cae-209a-4795-b46d-399cc886faf1 tempest-VolumesGetTest-911511621 None] Lock "cinder-499697cb-b11d-4c62-b4ff-43336bf163ae-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (59ccae13-623d-496f-aace-3b46c49d02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2987e186-7f80-4bf1-9c32-bc475c12bd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2987e186-7f80-4bf1-9c32-bc475c12bd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-821974376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b848198-613d-412f-a15d-9f0292c9c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:17Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423b760d-fe21-4d58-a7c3-0125551e3c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423b760d-fe21-4d58-a7c3-0125551e3c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f8e353-0e64-428f-abd3-85bf7d436104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f8e353-0e64-428f-abd3-85bf7d436104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b848198-613d-412f-a15d-9f0292c9c464', 'volume_name': 'volume-4b848198-613d-412f-a15d-9f0292c9c464', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b39c20-7b3f-4927-8861-10cc51805cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b39c20-7b3f-4927-8861-10cc51805cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b350efc3-a015-414a-89f6-aca6e55372a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:16 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Volume 4b848198-613d-412f-a15d-9f0292c9c464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b848198-613d-412f-a15d-9f0292c9c464', 'volume_size': 1} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-821974376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b848198-613d-412f-a15d-9f0292c9c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:17Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Creating volume 4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:16 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:16 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 1073741824 Jul 27 13:21:16 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:17 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 1073741824" returned: 0 in 0.496s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:17 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:17 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:17 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.327s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b350efc3-a015-414a-89f6-aca6e55372a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b848198-613d-412f-a15d-9f0292c9c464', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8150c0-1fa3-416e-923a-538a93fe0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:17 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Volume volume-4b848198-613d-412f-a15d-9f0292c9c464 (4b848198-613d-412f-a15d-9f0292c9c464): created successfully Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8150c0-1fa3-416e-923a-538a93fe0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (59ccae13-623d-496f-aace-3b46c49d02cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:17 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cdb9b2e3-3b72-4213-8e61-09d77d79be78 tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (ae9c487f-aa4d-4f11-862a-8ba71252665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f808a7-bba0-484e-add0-6ae3c3b5188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f808a7-bba0-484e-add0-6ae3c3b5188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1459996621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4b848198-613d-412f-a15d-9f0292c9c464,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:19Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dfbf0ac-87cb-40c9-a174-237e5f0562a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dfbf0ac-87cb-40c9-a174-237e5f0562a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26896fa-4606-48e7-baa9-0b19daf1007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26896fa-4606-48e7-baa9-0b19daf1007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a', 'volume_name': 'volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a', 'volume_size': 1, 'source_volid': '4b848198-613d-412f-a15d-9f0292c9c464', 'source_volstatus': 'available'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b436317b-9f98-46cd-a5a9-bdd7d1cf4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b436317b-9f98-46cd-a5a9-bdd7d1cf4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0962c993-77c3-4293-87dd-8aaae132c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:19 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Volume 00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a', 'volume_size': 1, 'source_volid': '4b848198-613d-412f-a15d-9f0292c9c464', 'source_volstatus': 'available'} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:19 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Cloning volume 4b848198-613d-412f-a15d-9f0292c9c464 to volume 00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Creating offline snapshot bebb8bec-ddbe-4efa-a69a-df784a057dfe of volume 4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[54380ca9-2a09-4ce6-934b-5420d2ccc6c6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:19 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:19 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:19 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.392s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:19 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe 1G Jul 27 13:21:19 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:20 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe 1G" returned: 0 in 0.476s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b848198-613d-412f-a15d-9f0292c9c464 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:20 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b848198-613d-412f-a15d-9f0292c9c464 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe Jul 27 13:21:20 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:20 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b848198-613d-412f-a15d-9f0292c9c464 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe" returned: 0 in 0.320s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:20 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe is being set with open permissions: ugo+rw Jul 27 13:21:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:20 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe Jul 27 13:21:20 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:20 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe" returned: 0 in 0.276s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:20 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info Jul 27 13:21:20 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:21 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info" returned: 0 in 0.310s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:21 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info is being set with open permissions: ugo+rw Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:21 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info Jul 27 13:21:21 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:21 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.info" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] snapshot: bebb8bec-ddbe-4efa-a69a-df784a057dfe, volume: 00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08ab44-4193-4ddb-b47f-8cfcf10ca000]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:21 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe Jul 27 13:21:21 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:22 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe" returned: 0 in 0.441s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b848198-613d-412f-a15d-9f0292c9c464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ca463-eeb1-43d1-bea6-5e3a05c01906]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:22 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:22 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:22 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.429s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:21:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:22 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a Jul 27 13:21:22 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:28 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" returned: 0 in 5.590s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:28 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220f74e-3c2a-494d-9da7-4e6b996d54ed]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:28 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:28 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:28 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.576s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:28 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:21:28 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Converted 1024.00 MB image at 183.14 MB/s Jul 27 13:21:28 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a is being set with open permissions: ugo+rw Jul 27 13:21:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:28 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a Jul 27 13:21:28 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:29 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" released by "_copy_volume_from_snapshot" :: held 7.423s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-bebb8bec-ddbe-4efa-a69a-df784a057dfe" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-bebb8bec-ddbe-4efa-a69a-df784a057dfe" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Deleting offline snapshot bebb8bec-ddbe-4efa-a69a-df784a057dfe of volume 4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] snapshot_file for this snap is: volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f04343-9efa-4216-a862-6ac0362f6bda]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:29 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe Jul 27 13:21:29 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:29 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe" returned: 0 in 0.419s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b848198-613d-412f-a15d-9f0292c9c464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8eaafb-5d5a-4ae4-9dc6-92b49daa1456]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:29 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:29 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:30 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.405s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:30 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe Jul 27 13:21:30 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:30 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe" returned: 0 in 0.450s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:30 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=173,cinder:UPDATE=177,cinder:INSERT=49,cinder:DELETE=10 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:21:30 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=146,cinder:INSERT=53,cinder:UPDATE=191,cinder:DELETE=16 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Flow 'volume_create_manager' (86c1dc3c-15e0-4b53-bbc4-75cc4e4c35af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9a6333-734f-432c-b975-a01527fa28a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9a6333-734f-432c-b975-a01527fa28a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1549148591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889aad3b-f599-4e93-971f-6da964a9348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145ba6ac73b64e08b7b644edbfbfeadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:30Z,use_quota=True,user_id='3bd0d4efd2c34da283346ec2c6ff679a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9aec6db-a73c-4d09-82ef-6a1f3c0d1d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9aec6db-a73c-4d09-82ef-6a1f3c0d1d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf7b3ff-eff2-485b-9dbe-c3442dad3dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf7b3ff-eff2-485b-9dbe-c3442dad3dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889aad3b-f599-4e93-971f-6da964a9348a', 'volume_name': 'volume-889aad3b-f599-4e93-971f-6da964a9348a', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97a0e19-987a-44d1-aed1-912b61e0aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97a0e19-987a-44d1-aed1-912b61e0aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a546b3-1c51-4ede-a596-46e0f71e0082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Volume 889aad3b-f599-4e93-971f-6da964a9348a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889aad3b-f599-4e93-971f-6da964a9348a', 'volume_size': 1} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:30 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464.bebb8bec-ddbe-4efa-a69a-df784a057dfe" returned: 0 in 0.290s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-bebb8bec-ddbe-4efa-a69a-df784a057dfe" released by "_delete_snapshot" :: held 1.681s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.442s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.180s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1549148591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889aad3b-f599-4e93-971f-6da964a9348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145ba6ac73b64e08b7b644edbfbfeadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:30Z,use_quota=True,user_id='3bd0d4efd2c34da283346ec2c6ff679a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Creating volume 889aad3b-f599-4e93-971f-6da964a9348a {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:30 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0962c993-77c3-4293-87dd-8aaae132c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a', 'volume_size': 1, 'source_volid': '4b848198-613d-412f-a15d-9f0292c9c464', 'source_volstatus': 'available'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:30 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a 1073741824 Jul 27 13:21:30 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94262b36-e6c1-481e-beec-4a070d42a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Volume volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a (00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a): created successfully Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94262b36-e6c1-481e-beec-4a070d42a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (ae9c487f-aa4d-4f11-862a-8ba71252665a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-25f7208e-e630-4ef8-b668-7eb261357ad7 tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:31 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a 1073741824" returned: 0 in 0.454s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:31 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a Jul 27 13:21:31 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:31 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a" returned: 0 in 0.332s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a546b3-1c51-4ede-a596-46e0f71e0082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889aad3b-f599-4e93-971f-6da964a9348a', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78020954-c9c0-4a71-b07c-04e089e0c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Volume volume-889aad3b-f599-4e93-971f-6da964a9348a (889aad3b-f599-4e93-971f-6da964a9348a): created successfully Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78020954-c9c0-4a71-b07c-04e089e0c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Flow 'volume_create_manager' (86c1dc3c-15e0-4b53-bbc4-75cc4e4c35af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7de48a31-9c5a-4d10-b0a3-268b08034b36 tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Created volume successfully. Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (c10fd005-da93-4354-b7a0-6c2159fdceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b35f49-745d-4339-8f68-254f7dbb268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b35f49-745d-4339-8f68-254f7dbb268e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-32027280',display_name='tempest-VolumesGetTest-Volume-1757734943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95751bd5-3f0c-4e6e-a696-d048fa7145e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:32Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff5f506-eacf-4cbf-be18-bebc27f16faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff5f506-eacf-4cbf-be18-bebc27f16faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3557f64-24d3-4f14-813a-111c0f1ef4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3557f64-24d3-4f14-813a-111c0f1ef4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95751bd5-3f0c-4e6e-a696-d048fa7145e4', 'volume_name': 'volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dc4751-71ac-411f-8b7b-265b8ee82881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dc4751-71ac-411f-8b7b-265b8ee82881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f98db0-6a10-476d-a86d-f8f414b1a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Volume 95751bd5-3f0c-4e6e-a696-d048fa7145e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4', 'volume_size': 1} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-32027280',display_name='tempest-VolumesGetTest-Volume-1757734943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95751bd5-3f0c-4e6e-a696-d048fa7145e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:32Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Creating volume 95751bd5-3f0c-4e6e-a696-d048fa7145e4 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:32 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:32 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 1073741824 Jul 27 13:21:32 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:32 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 1073741824" returned: 0 in 0.504s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:33 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 Jul 27 13:21:33 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:33 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:33 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:33 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4" returned: 0 in 0.305s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f98db0-6a10-476d-a86d-f8f414b1a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e8e7a7-5c8f-46f8-b873-92023ab1cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:33 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Volume volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 (95751bd5-3f0c-4e6e-a696-d048fa7145e4): created successfully Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e8e7a7-5c8f-46f8-b873-92023ab1cb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (c10fd005-da93-4354-b7a0-6c2159fdceeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:33 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.309s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:21:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bfbcf56f-7e55-4b1a-9bd1-3a70605f6cf6 tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Acquiring lock "cinder-889aad3b-f599-4e93-971f-6da964a9348a-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "cinder-889aad3b-f599-4e93-971f-6da964a9348a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Acquiring lock "cinder-quobyte-889aad3b-f599-4e93-971f-6da964a9348a" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "cinder-quobyte-889aad3b-f599-4e93-971f-6da964a9348a" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa6aaba-fd31-4edf-9585-3de9da88ef4a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:33 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a Jul 27 13:21:33 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:34 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a" returned: 0 in 0.395s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:34 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a Jul 27 13:21:34 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:34 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-889aad3b-f599-4e93-971f-6da964a9348a" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "cinder-quobyte-889aad3b-f599-4e93-971f-6da964a9348a" released by "delete_volume" :: held 0.709s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Created reservations ['39a3f67b-1527-47eb-90c4-df50f4cd6ef3', 'bc22ec23-2fb3-4992-be87-c5055f838d10', '854b35f2-4e46-4a4b-8ea3-77251bcc2b0e', '455f617f-0a1d-4bae-a988-ce6300ce8a6b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-95751bd5-3f0c-4e6e-a696-d048fa7145e4-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Lock "cinder-95751bd5-3f0c-4e6e-a696-d048fa7145e4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:34 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:34 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-95751bd5-3f0c-4e6e-a696-d048fa7145e4" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-95751bd5-3f0c-4e6e-a696-d048fa7145e4" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02438f2-c5e1-4591-87bb-9aaec6a4a218]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:34 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 Jul 27 13:21:34 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:35 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.340s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Deleted volume successfully. Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-12ab976a-ce81-439c-aa2a-5780c7b4529a tempest-VolumeQuotasNegativeTestJSON-1018503784 None] Lock "cinder-889aad3b-f599-4e93-971f-6da964a9348a-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:35 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4" returned: 0 in 0.409s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:35 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4 Jul 27 13:21:35 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:35 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95751bd5-3f0c-4e6e-a696-d048fa7145e4" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-95751bd5-3f0c-4e6e-a696-d048fa7145e4" released by "delete_volume" :: held 0.753s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Created reservations ['9f53c8fa-eadb-44b3-98f9-718e88095b65', 'f20d20b1-668d-46ab-a90e-8857a270aafb', '207cfb6c-d6c5-435f-b35b-2ad8ed7dde30', 'a79859ef-d7e9-47ac-be4a-c60da90fda7e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:35 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:35 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Lock "cinder-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:35 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cd995eab-a22b-4e29-9c03-aca3326a8688 tempest-VolumesGetTest-911511621 None] Lock "cinder-95751bd5-3f0c-4e6e-a696-d048fa7145e4-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34456c8-436f-4d63-b2ff-ba311d334d44]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:36 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a Jul 27 13:21:36 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:36 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" returned: 0 in 0.461s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:36 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a Jul 27 13:21:36 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:36 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" returned: 0 in 0.332s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a" released by "delete_volume" :: held 0.856s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Created reservations ['c6d8a807-8d91-4edd-8827-2765c7684185', 'e7618161-902e-4a87-b1ff-7e653e5de426', '8e8f292e-1d06-411b-aa61-3bd826f905c7', '9f25ecce-2d3f-4520-aedf-f13d5a6387bf'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:37 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:37 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-4b848198-613d-412f-a15d-9f0292c9c464-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Lock "cinder-4b848198-613d-412f-a15d-9f0292c9c464-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-4b848198-613d-412f-a15d-9f0292c9c464" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-4b848198-613d-412f-a15d-9f0292c9c464" acquired by "delete_volume" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cdad3b-9d10-46b0-8cd7-98c156ef5789]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:37 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.437s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-64b33d83-4242-4024-9edb-a153017e44e0 tempest-VolumesGetTest-911511621 None] Lock "cinder-00c0b4a1-fe3f-452f-8c41-74dfb0be1f6a-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:37 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:37 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:37 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.466s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:37 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464 Jul 27 13:21:37 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:38 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4b848198-613d-412f-a15d-9f0292c9c464" returned: 0 in 0.288s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-4b848198-613d-412f-a15d-9f0292c9c464" released by "delete_volume" :: held 0.856s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Created reservations ['dc4e3350-bdd5-4f24-830a-eb35350bc4c5', 'c1a0986d-8b6d-4908-b7c3-a3bf24a4b80f', '260489f8-bb40-4315-8eaa-f1f9476a28db', 'd47545a4-8ad8-41c9-b079-315426d26d80'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:38 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:38 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:38 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.308s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:38 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-546073b0-6a3b-46dd-8d47-e7ca78f33043 tempest-VolumesGetTest-911511621 None] Lock "cinder-4b848198-613d-412f-a15d-9f0292c9c464-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (cd3eb09c-023c-4270-8ded-aa9be61b4f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80b9646-6683-4ba7-a1ae-526e0b696049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80b9646-6683-4ba7-a1ae-526e0b696049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1470246776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446d9f17-3cf4-495a-b891-047388b23382,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:39Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8344d4b-b43a-4581-ad35-993181dacb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8344d4b-b43a-4581-ad35-993181dacb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767fb35a-8ebc-40d7-a110-3d713fddc61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767fb35a-8ebc-40d7-a110-3d713fddc61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '446d9f17-3cf4-495a-b891-047388b23382', 'volume_name': 'volume-446d9f17-3cf4-495a-b891-047388b23382', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc03539-eb7e-477c-bb6c-06d6c88d0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc03539-eb7e-477c-bb6c-06d6c88d0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d721c02-2218-4d0a-b650-a2b6bcd82959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:39 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Volume 446d9f17-3cf4-495a-b891-047388b23382: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-446d9f17-3cf4-495a-b891-047388b23382', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 27 13:21:39 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Trying to clone 446d9f17-3cf4-495a-b891-047388b23382 from image d5827fb8-683b-418e-8e22-9911b3a6a38f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:21:40 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Image download 20.69 MB at 20.69 MB/s Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[329bba93-5ce2-4bc1-8176-7b3234f87c1a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:40 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD Jul 27 13:21:40 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Flow 'volume_create_manager' (a5f8befe-5bd6-440e-9a18-d84a9e15e697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99d59d8-3716-48f1-a7e9-476cc0d4f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99d59d8-3716-48f1-a7e9-476cc0d4f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-362415520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5b6426-e6e6-44fa-acdf-8bf83db0c86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12585e3beb9842a7982e979f4c6191bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:40Z,use_quota=True,user_id='40b9fe4e5ce04081b8c4f01eadde3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84e8108-4b38-4f59-b096-77b169b6437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84e8108-4b38-4f59-b096-77b169b6437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eef7678-90b8-47ee-bb18-0bd89ec96ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eef7678-90b8-47ee-bb18-0bd89ec96ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5b6426-e6e6-44fa-acdf-8bf83db0c86e', 'volume_name': 'volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88172624-d68f-431a-8cf1-ae3295720962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88172624-d68f-431a-8cf1-ae3295720962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c912137-5c68-4022-b59a-4becd50d6ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:40 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Volume be5b6426-e6e6-44fa-acdf-8bf83db0c86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e', 'volume_size': 1} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-362415520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5b6426-e6e6-44fa-acdf-8bf83db0c86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12585e3beb9842a7982e979f4c6191bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:40Z,use_quota=True,user_id='40b9fe4e5ce04081b8c4f01eadde3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Creating volume be5b6426-e6e6-44fa-acdf-8bf83db0c86e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:40 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:40 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e 1073741824 Jul 27 13:21:40 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:40 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f is fetched for user cebfc316da424ba1af49f6ba966e28cc. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9ed427-026b-46c2-99ed-a53973c7ea47]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:40 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD Jul 27 13:21:40 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:40 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e 1073741824" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:41 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e Jul 27 13:21:41 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:41 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Flow 'volume_create_manager' (e5d90614-c4b0-458b-a400-1690f06cd704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f2838b-5c1b-4294-a1b6-ed3b8311480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f2838b-5c1b-4294-a1b6-ed3b8311480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1022888273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83a4cd0-b815-445b-94f8-26bbd665788c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb619cc8294ccbb99ca91e391189fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:41Z,use_quota=True,user_id='06bef4b3923f457db785fa9d76cfb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0c99541-ca90-4c60-9ec4-33fff8161233),volume_type_id=a0c99541-ca90-4c60-9ec4-33fff8161233)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d952cc9e-cdad-46c4-9689-824c7bc384e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d952cc9e-cdad-46c4-9689-824c7bc384e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4523e5c-697e-4803-b9a0-707fa64744b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4523e5c-697e-4803-b9a0-707fa64744b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83a4cd0-b815-445b-94f8-26bbd665788c', 'volume_name': 'volume-f83a4cd0-b815-445b-94f8-26bbd665788c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd8ef2c-be2e-418f-8971-26b900656b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd8ef2c-be2e-418f-8971-26b900656b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563d91fe-82d4-4f9a-be66-2b3e718f5043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:41 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Volume f83a4cd0-b815-445b-94f8-26bbd665788c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83a4cd0-b815-445b-94f8-26bbd665788c', 'volume_size': 1} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:41 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1470246776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446d9f17-3cf4-495a-b891-047388b23382,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:39Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Creating volume 446d9f17-3cf4-495a-b891-047388b23382 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:41 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c912137-5c68-4022-b59a-4becd50d6ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:41 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 1073741824 Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2189242-f187-448a-85a3-44a88a669b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:41 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:41 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Volume volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e (be5b6426-e6e6-44fa-acdf-8bf83db0c86e): created successfully Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2189242-f187-448a-85a3-44a88a669b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Flow 'volume_create_manager' (a5f8befe-5bd6-440e-9a18-d84a9e15e697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-497e53ff-7a53-44ff-8aff-002c168489af tempest-VolumesMetadataTest-1010746792 None] Created volume successfully. Jul 27 13:21:41 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 1073741824" returned: 0 in 0.445s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:41 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 Jul 27 13:21:41 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:41 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382" returned: 0 in 0.250s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1022888273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83a4cd0-b815-445b-94f8-26bbd665788c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb619cc8294ccbb99ca91e391189fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:41Z,use_quota=True,user_id='06bef4b3923f457db785fa9d76cfb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0c99541-ca90-4c60-9ec4-33fff8161233),volume_type_id=a0c99541-ca90-4c60-9ec4-33fff8161233)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Creating volume f83a4cd0-b815-445b-94f8-26bbd665788c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:41 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:42 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c 1073741824 Jul 27 13:21:42 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Attempting download of d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume 446d9f17-3cf4-495a-b891-047388b23382. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e01b64-695e-4f61-80cf-0c593aa210e0]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:42 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p Jul 27 13:21:42 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:42 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p" returned: 0 in 0.361s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:42 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c 1073741824" returned: 0 in 0.480s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:42 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c Jul 27 13:21:42 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:42 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p Jul 27 13:21:42 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:42 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563d91fe-82d4-4f9a-be66-2b3e718f5043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83a4cd0-b815-445b-94f8-26bbd665788c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deabf4d4-7134-451d-a25f-ec9b9861b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:42 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p" returned: 1 in 0.361s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_uhj0i60p' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:21:42 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Volume volume-f83a4cd0-b815-445b-94f8-26bbd665788c (f83a4cd0-b815-445b-94f8-26bbd665788c): created successfully Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deabf4d4-7134-451d-a25f-ec9b9861b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Flow 'volume_create_manager' (e5d90614-c4b0-458b-a400-1690f06cd704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[79818476-705a-45b5-90ef-35381e6c7ec2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-de3c3845-c8ef-470d-b63b-bb3c9ea353d6 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Created volume successfully. Jul 27 13:21:42 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD Jul 27 13:21:42 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Acquiring lock "cinder-be5b6426-e6e6-44fa-acdf-8bf83db0c86e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Lock "cinder-be5b6426-e6e6-44fa-acdf-8bf83db0c86e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:43 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] d5827fb8-683b-418e-8e22-9911b3a6a38f was qcow2, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Acquiring lock "cinder-quobyte-be5b6426-e6e6-44fa-acdf-8bf83db0c86e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Lock "cinder-quobyte-be5b6426-e6e6-44fa-acdf-8bf83db0c86e" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:43 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 Jul 27 13:21:43 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[856692d1-cf70-4413-926b-cbc442144e2a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:43 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e Jul 27 13:21:43 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:43 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:43 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:43 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e" returned: 0 in 0.426s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:43 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e Jul 27 13:21:43 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:43 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:43 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a35ca17a-e5b3-4d2b-b205-0954f6a3b4ff tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Retype volume completed successfully. Jul 27 13:21:44 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-be5b6426-e6e6-44fa-acdf-8bf83db0c86e" returned: 0 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Lock "cinder-quobyte-be5b6426-e6e6-44fa-acdf-8bf83db0c86e" released by "delete_volume" :: held 0.830s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Created reservations ['5ef4c2d0-8178-4535-ac46-b8db900deced', '78409876-af16-4ca5-bcee-32dc4190cddd', 'c462ac70-c678-45e8-9b68-aebff6ffa83e', '8d4442cc-6320-4589-b479-761269b91ae5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:44 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:44 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:44 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.291s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Deleted volume successfully. Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-048b9f32-dd39-4249-92be-f02438635004 tempest-VolumesMetadataTest-1010746792 None] Lock "cinder-be5b6426-e6e6-44fa-acdf-8bf83db0c86e-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Acquiring lock "cinder-f83a4cd0-b815-445b-94f8-26bbd665788c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "cinder-f83a4cd0-b815-445b-94f8-26bbd665788c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Acquiring lock "cinder-quobyte-f83a4cd0-b815-445b-94f8-26bbd665788c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "cinder-quobyte-f83a4cd0-b815-445b-94f8-26bbd665788c" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[435337ad-ad33-4d48-8afc-cb75ffeb7397]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:45 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382" returned: 0 in 1.972s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_765dev5ydevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:21:45 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Converted 112.00 MB image at 56.75 MB/s Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:45 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c Jul 27 13:21:45 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:45 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 1G Jul 27 13:21:45 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:45 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c" returned: 0 in 0.460s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:45 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c Jul 27 13:21:45 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:45 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 1G" returned: 0 in 0.350s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Downloaded image d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume 446d9f17-3cf4-495a-b891-047388b23382 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f for user cebfc316da424ba1af49f6ba966e28cc is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Marking volume 446d9f17-3cf4-495a-b891-047388b23382 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Copying metadata from image d5827fb8-683b-418e-8e22-9911b3a6a38f to 446d9f17-3cf4-495a-b891-047388b23382. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Creating volume glance metadata for volume 446d9f17-3cf4-495a-b891-047388b23382 backed by image d5827fb8-683b-418e-8e22-9911b3a6a38f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d721c02-2218-4d0a-b650-a2b6bcd82959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446d9f17-3cf4-495a-b891-047388b23382', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe74927-bb2d-4465-9aaa-53cfe5395ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:45 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Volume volume-446d9f17-3cf4-495a-b891-047388b23382 (446d9f17-3cf4-495a-b891-047388b23382): created successfully Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe74927-bb2d-4465-9aaa-53cfe5395ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (cd3eb09c-023c-4270-8ded-aa9be61b4f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-524e3fe9-7e9d-4180-a70c-2798ea6992f6 tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:45 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f83a4cd0-b815-445b-94f8-26bbd665788c" returned: 0 in 0.293s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "cinder-quobyte-f83a4cd0-b815-445b-94f8-26bbd665788c" released by "delete_volume" :: held 0.802s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:45 devstack cinder-volume[88202]: WARNING cinder.quota [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:21:45 devstack cinder-volume[88202]: WARNING cinder.quota [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Created reservations ['917a377f-79a0-4265-969c-90a492333c50', 'dc3eb184-f98c-4f59-bd62-ef89b253b6b2', 'd2ff5800-e862-4af7-bd8e-4833c5482a1a', 'ad59f9c5-ec3c-4c85-991b-321e50ddaa54'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:45 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:45 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:46 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.277s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:46 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Deleted volume successfully. Jul 27 13:21:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ea99f25-450f-468d-b31b-9ffe61a1ed76 tempest-VolumeRetypeWithoutMigrationTest-751292450 None] Lock "cinder-f83a4cd0-b815-445b-94f8-26bbd665788c-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (216b3708-a381-43a6-857d-fbb6328bf14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391c188e-4049-4533-81bd-a3895232fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391c188e-4049-4533-81bd-a3895232fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-135358094',display_name='tempest-VolumesGetTest-Volume-138822893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770d8e52-1d79-4f92-9e6f-89b925c7e00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:48Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f64c14-f4c9-479d-a260-8548ad0c2ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f64c14-f4c9-479d-a260-8548ad0c2ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265bbdd6-013c-4bf0-a361-d4fc699e9435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265bbdd6-013c-4bf0-a361-d4fc699e9435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770d8e52-1d79-4f92-9e6f-89b925c7e00d', 'volume_name': 'volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf5ff7e-8c3a-4c5e-89b7-683d070d5639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf5ff7e-8c3a-4c5e-89b7-683d070d5639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088e0754-6cef-4e9d-a415-28ef7749ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Volume 770d8e52-1d79-4f92-9e6f-89b925c7e00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d', 'volume_size': 1} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-135358094',display_name='tempest-VolumesGetTest-Volume-138822893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770d8e52-1d79-4f92-9e6f-89b925c7e00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fd50ebe7a0498d98c8172fc13b149c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:48Z,use_quota=True,user_id='cebfc316da424ba1af49f6ba966e28cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Creating volume 770d8e52-1d79-4f92-9e6f-89b925c7e00d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:47 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:47 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d 1073741824 Jul 27 13:21:47 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:48 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d 1073741824" returned: 0 in 0.509s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:48 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d Jul 27 13:21:48 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:48 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d" returned: 0 in 0.290s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088e0754-6cef-4e9d-a415-28ef7749ab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6e725a-34ef-432f-acf7-dea3053793fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:48 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Volume volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d (770d8e52-1d79-4f92-9e6f-89b925c7e00d): created successfully Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6e725a-34ef-432f-acf7-dea3053793fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Flow 'volume_create_manager' (216b3708-a381-43a6-857d-fbb6328bf14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8f40b1c5-4278-4754-b981-924bac8ec7c7 tempest-VolumesGetTest-911511621 None] Created volume successfully. Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Flow 'volume_create_manager' (7c3dc79d-5f6f-4de5-9ea9-dd4e07132967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c058d7-06aa-4da0-8336-97cc06c39afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c058d7-06aa-4da0-8336-97cc06c39afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-350224308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9009f29-7f27-453e-9b9b-0c3c68181af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a5a28c2615466bb542936d0a90f1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:49Z,use_quota=True,user_id='52d4391fa42744b5827c83bccafa2260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954f3f16-718d-4454-9c9e-b70c6631e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954f3f16-718d-4454-9c9e-b70c6631e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f62734-dcb2-4ea3-b86b-5bf45cb43e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f62734-dcb2-4ea3-b86b-5bf45cb43e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9009f29-7f27-453e-9b9b-0c3c68181af7', 'volume_name': 'volume-a9009f29-7f27-453e-9b9b-0c3c68181af7', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939004b1-9874-49ae-ba78-f55728c75d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939004b1-9874-49ae-ba78-f55728c75d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168e2f57-05e1-4143-8a3e-e25e918c3f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:49 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Volume a9009f29-7f27-453e-9b9b-0c3c68181af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9009f29-7f27-453e-9b9b-0c3c68181af7', 'volume_size': 1} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-350224308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9009f29-7f27-453e-9b9b-0c3c68181af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a5a28c2615466bb542936d0a90f1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:49Z,use_quota=True,user_id='52d4391fa42744b5827c83bccafa2260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Creating volume a9009f29-7f27-453e-9b9b-0c3c68181af7 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:49 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:49 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 1073741824 Jul 27 13:21:49 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-770d8e52-1d79-4f92-9e6f-89b925c7e00d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Lock "cinder-770d8e52-1d79-4f92-9e6f-89b925c7e00d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-770d8e52-1d79-4f92-9e6f-89b925c7e00d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-770d8e52-1d79-4f92-9e6f-89b925c7e00d" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd93e31-fdb3-40b3-9bd7-c664473c09c4]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:50 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d Jul 27 13:21:50 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:50 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 1073741824" returned: 0 in 0.520s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:50 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 Jul 27 13:21:50 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:50 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d" returned: 0 in 0.454s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:50 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d Jul 27 13:21:50 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:50 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7" returned: 0 in 0.312s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168e2f57-05e1-4143-8a3e-e25e918c3f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9009f29-7f27-453e-9b9b-0c3c68181af7', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cb9199-e64f-4444-b6c7-d7d0ca4cf78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:50 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Volume volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 (a9009f29-7f27-453e-9b9b-0c3c68181af7): created successfully Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cb9199-e64f-4444-b6c7-d7d0ca4cf78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Flow 'volume_create_manager' (7c3dc79d-5f6f-4de5-9ea9-dd4e07132967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-13a3a1a2-19b1-4cd4-891b-bcdf6ce44707 tempest-VolumesTransfersV357Test-1431284787 None] Created volume successfully. Jul 27 13:21:50 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-770d8e52-1d79-4f92-9e6f-89b925c7e00d" returned: 0 in 0.299s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-770d8e52-1d79-4f92-9e6f-89b925c7e00d" released by "delete_volume" :: held 0.797s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Created reservations ['313f5c67-1268-4d4f-8d00-92ba2c49714b', 'a8d9f282-69c3-4af2-865d-ff6e22490edc', '6d302846-a4a5-4ce4-89ef-925f37e47f91', '909a4a17-a3d2-4433-9c74-bec4d4331a4b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:50 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:50 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:51 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:51 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-446d9f17-3cf4-495a-b891-047388b23382-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Lock "cinder-446d9f17-3cf4-495a-b891-047388b23382-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-68dade5c-bbef-46d1-8ac9-3543a36fe380 tempest-VolumesGetTest-911511621 None] Lock "cinder-770d8e52-1d79-4f92-9e6f-89b925c7e00d-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Acquiring lock "cinder-quobyte-446d9f17-3cf4-495a-b891-047388b23382" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-446d9f17-3cf4-495a-b891-047388b23382" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[614df5ab-b5f9-4774-aeeb-8f266c6c9aba]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:51 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 Jul 27 13:21:51 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:51 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382" returned: 0 in 0.396s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:51 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382 Jul 27 13:21:51 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:51 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-446d9f17-3cf4-495a-b891-047388b23382" returned: 0 in 0.272s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Lock "cinder-quobyte-446d9f17-3cf4-495a-b891-047388b23382" released by "delete_volume" :: held 0.723s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:51 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Created reservations ['aa986be6-a1bc-4413-839f-17d87407cdbc', '3e516d09-0131-4cad-882c-7f907d19ebde', '88d29068-f9a6-485f-a2c0-088c5515fbbb', '77d0f87e-55a0-436c-b133-d110b5d12b67'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:52 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:52 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Flow 'volume_create_manager' (1483bbe5-28c8-40c0-9a71-026262b662d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08de3f9-e25c-4e89-9078-c12adb0f3ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f2820909-a051-448a-83f9-181b1d145444 tempest-VolumesTransfersV357Test-511706726 None] Transfer volume completed successfully. Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08de3f9-e25c-4e89-9078-c12adb0f3ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-938003423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b6e010-c945-4466-a6ba-014c5c610294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f795b83de0a4c42aa96c381031c4e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:52Z,use_quota=True,user_id='b6b4bb7419af40c5ba47400a490516a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b4fd54-b11d-46cb-becc-d5c8aca06fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b4fd54-b11d-46cb-becc-d5c8aca06fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ea9b53-0eb2-453a-9a86-309df1398e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ea9b53-0eb2-453a-9a86-309df1398e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b6e010-c945-4466-a6ba-014c5c610294', 'volume_name': 'volume-32b6e010-c945-4466-a6ba-014c5c610294', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883988d4-b97c-4e81-aadd-fda910940c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883988d4-b97c-4e81-aadd-fda910940c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776b5401-446a-46f9-a4b4-c4a78e1fbfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Volume 32b6e010-c945-4466-a6ba-014c5c610294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b6e010-c945-4466-a6ba-014c5c610294', 'volume_size': 1} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-938003423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b6e010-c945-4466-a6ba-014c5c610294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f795b83de0a4c42aa96c381031c4e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:52Z,use_quota=True,user_id='b6b4bb7419af40c5ba47400a490516a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Creating volume 32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:52 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:52 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.351s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Deleted volume successfully. Jul 27 13:21:52 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 1073741824 Jul 27 13:21:52 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f7a6007b-1dc5-4f8a-ab0c-b380c55bf8d4 tempest-VolumesGetTest-911511621 None] Lock "cinder-446d9f17-3cf4-495a-b891-047388b23382-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:52 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 1073741824" returned: 0 in 0.635s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:53 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 Jul 27 13:21:53 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Acquiring lock "cinder-a9009f29-7f27-453e-9b9b-0c3c68181af7-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-a9009f29-7f27-453e-9b9b-0c3c68181af7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Acquiring lock "cinder-quobyte-a9009f29-7f27-453e-9b9b-0c3c68181af7" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-quobyte-a9009f29-7f27-453e-9b9b-0c3c68181af7" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb16daf-6878-493a-8f32-c568d2ca6f27]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:53 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 Jul 27 13:21:53 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:53 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776b5401-446a-46f9-a4b4-c4a78e1fbfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b6e010-c945-4466-a6ba-014c5c610294', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96c88f2-8d7e-422a-b9d6-94997bfbac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Volume volume-32b6e010-c945-4466-a6ba-014c5c610294 (32b6e010-c945-4466-a6ba-014c5c610294): created successfully Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96c88f2-8d7e-422a-b9d6-94997bfbac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Flow 'volume_create_manager' (1483bbe5-28c8-40c0-9a71-026262b662d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f1525f13-2356-4403-bcc1-4d3d8d9006ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Created volume successfully. Jul 27 13:21:53 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:53 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7 Jul 27 13:21:53 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:53 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a9009f29-7f27-453e-9b9b-0c3c68181af7" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-quobyte-a9009f29-7f27-453e-9b9b-0c3c68181af7" released by "delete_volume" :: held 0.692s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:53 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Created reservations ['5a797b36-332e-4742-be21-a362996b9ecc', '40c60dfd-4b5c-4228-8b5e-8496d6f76ef4', '3dc4f630-111e-4729-97af-1ff62921232f', '9780d93c-6a51-4403-9ee2-cd88ac98fa0c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:54 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:54 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:54 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.258s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Deleted volume successfully. Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-be02a9e1-882d-4d07-b97b-e2ad5057b01d tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-a9009f29-7f27-453e-9b9b-0c3c68181af7-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Creating offline snapshot 77508d97-eda1-4ced-918d-7bace5b4eef0 of volume 32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f235b964-9b76-4008-b1c0-acedeecc193b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:54 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 Jul 27 13:21:54 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Flow 'volume_create_manager' (fa09914a-8ac9-4730-9eec-bc8ca8909324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cbb885-c4fe-4d91-9fa4-2149b164d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cbb885-c4fe-4d91-9fa4-2149b164d77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-403877819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce10bd9-eba2-4e2e-bf0a-4450694f22d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a5a28c2615466bb542936d0a90f1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:55Z,use_quota=True,user_id='52d4391fa42744b5827c83bccafa2260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9345b704-1403-426b-860c-a0efd7fa70d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9345b704-1403-426b-860c-a0efd7fa70d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efce81a0-e64f-4705-96aa-b8d744963f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efce81a0-e64f-4705-96aa-b8d744963f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce10bd9-eba2-4e2e-bf0a-4450694f22d4', 'volume_name': 'volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d62d93-bd92-4ce7-ac20-49d52bc0b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d62d93-bd92-4ce7-ac20-49d52bc0b73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201b70f2-70ab-4d58-b0e1-3caffe5d9731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Volume 8ce10bd9-eba2-4e2e-bf0a-4450694f22d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4', 'volume_size': 1} Jul 27 13:21:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:55 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:55 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 1G Jul 27 13:21:55 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:55 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 1G" returned: 0 in 0.440s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b6e010-c945-4466-a6ba-014c5c610294 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:55 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b6e010-c945-4466-a6ba-014c5c610294 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 Jul 27 13:21:55 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Flow 'volume_create_manager' (6fe8d21b-74c4-48be-bce5-f2b1b0f337e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3ed257-dff1-4483-94d9-e6601061db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3ed257-dff1-4483-94d9-e6601061db31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-765033222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb81777-8170-4d87-bf46-56da5a01401f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a85cfaf1e47b68b8498d1c70d5a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:55Z,use_quota=True,user_id='392223fdb3f2407c8c02d4acc3ca9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59364ec4-d9be-43c8-b04a-226b18d38c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59364ec4-d9be-43c8-b04a-226b18d38c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99368623-8e1f-49a9-b9e8-1116cb8a57b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99368623-8e1f-49a9-b9e8-1116cb8a57b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb81777-8170-4d87-bf46-56da5a01401f', 'volume_name': 'volume-1eb81777-8170-4d87-bf46-56da5a01401f', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e97a4-2b5c-48a0-a012-117dfa71ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e97a4-2b5c-48a0-a012-117dfa71ba76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4120a27d-b8a4-4518-b242-679d49cee43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Volume 1eb81777-8170-4d87-bf46-56da5a01401f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb81777-8170-4d87-bf46-56da5a01401f', 'volume_size': 1} Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:55 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b6e010-c945-4466-a6ba-014c5c610294 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0" returned: 0 in 0.292s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:55 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 is being set with open permissions: ugo+rw Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:55 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 Jul 27 13:21:55 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:55 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0" returned: 0 in 0.246s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:56 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info Jul 27 13:21:56 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:56 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info" returned: 0 in 0.249s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:56 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info is being set with open permissions: ugo+rw Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:56 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info Jul 27 13:21:56 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:56 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.info" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-403877819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce10bd9-eba2-4e2e-bf0a-4450694f22d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a5a28c2615466bb542936d0a90f1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:55Z,use_quota=True,user_id='52d4391fa42744b5827c83bccafa2260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Creating volume 8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:56 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 1073741824 Jul 27 13:21:56 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f9a0b360-d62b-4514-b0ab-6824bcfb8734 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Create snapshot completed successfully Jul 27 13:21:56 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 1073741824" returned: 0 in 0.417s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:57 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 Jul 27 13:21:57 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:57 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4" returned: 0 in 0.246s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-765033222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb81777-8170-4d87-bf46-56da5a01401f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8a85cfaf1e47b68b8498d1c70d5a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:21:55Z,use_quota=True,user_id='392223fdb3f2407c8c02d4acc3ca9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Creating volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:21:57 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201b70f2-70ab-4d58-b0e1-3caffe5d9731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:57 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f 1073741824 Jul 27 13:21:57 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13005cc8-7faa-4c3b-8aa7-e6c524a92edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:57 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Volume volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 (8ce10bd9-eba2-4e2e-bf0a-4450694f22d4): created successfully Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13005cc8-7faa-4c3b-8aa7-e6c524a92edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Flow 'volume_create_manager' (fa09914a-8ac9-4730-9eec-bc8ca8909324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8d105ae6-9efe-4d08-bcec-4de9429cb255 tempest-VolumesTransfersV357Test-1431284787 None] Created volume successfully. Jul 27 13:21:57 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f 1073741824" returned: 0 in 0.439s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:57 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f Jul 27 13:21:57 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:58 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4120a27d-b8a4-4518-b242-679d49cee43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb81777-8170-4d87-bf46-56da5a01401f', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19889330-6bf5-4777-b3dc-d9087feaccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:21:58 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Volume volume-1eb81777-8170-4d87-bf46-56da5a01401f (1eb81777-8170-4d87-bf46-56da5a01401f): created successfully Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19889330-6bf5-4777-b3dc-d9087feaccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Flow 'volume_create_manager' (6fe8d21b-74c4-48be-bce5-f2b1b0f337e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:21:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-09845d13-2bd4-45b8-9c93-fd8ad8fc2230 tempest-VolumesSnapshotListTestJSON-2107311962 None] Created volume successfully. Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "cinder-77508d97-eda1-4ced-918d-7bace5b4eef0-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-77508d97-eda1-4ced-918d-7bace5b4eef0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "cinder-quobyte-32b6e010-c945-4466-a6ba-014c5c610294" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-quobyte-32b6e010-c945-4466-a6ba-014c5c610294" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "cinder-quobyte-77508d97-eda1-4ced-918d-7bace5b4eef0" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-quobyte-77508d97-eda1-4ced-918d-7bace5b4eef0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Deleting offline snapshot 77508d97-eda1-4ced-918d-7bace5b4eef0 of volume 32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] snapshot_file for this snap is: volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Acquiring lock "cinder-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5e1f5c-4a97-419d-b411-5cc3ac7f872f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Acquiring lock "cinder-quobyte-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-quobyte-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f29f6-8cbc-4cfb-a221-68985b545267]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:58 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 Jul 27 13:21:58 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:58 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 Jul 27 13:21:58 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:58 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0" returned: 0 in 0.397s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b6e010-c945-4466-a6ba-014c5c610294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f6d651-2f31-4c3f-9cd6-b648ae14e101]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:58 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4" returned: 0 in 0.405s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Creating offline snapshot 40ddcdde-dcef-4d47-bd31-cd1e28b0f65a of volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:21:58 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4 Jul 27 13:21:58 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[810beb6f-3ff1-4912-8cdb-010d5ffb4a38]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:21:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:58 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 Jul 27 13:21:58 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:58 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f Jul 27 13:21:58 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:59 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-quobyte-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4" released by "delete_volume" :: held 0.712s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:59 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Created reservations ['7e83dbd0-c155-4585-9787-9e1c1523d6d8', '18656f27-0947-49f4-a62f-11c46aa7b68e', '021bc2d1-81b6-448f-bc9c-a280f097ed04', '46ae4f3a-399d-4fe7-aa00-c18e7253320b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:59 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 Jul 27 13:21:59 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:21:59 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:59 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:21:59 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:59 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a 1G Jul 27 13:21:59 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:59 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.275s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:21:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Deleted volume successfully. Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd0782cb-367f-4660-b455-d705cb0bf0a3 tempest-VolumesTransfersV357Test-1382498745 None] Lock "cinder-8ce10bd9-eba2-4e2e-bf0a-4450694f22d4-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:59 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0" returned: 0 in 0.456s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:59 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0 Jul 27 13:21:59 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:59 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a 1G" returned: 0 in 0.502s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:21:59 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:21:59 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:21:59 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294.77508d97-eda1-4ced-918d-7bace5b4eef0" returned: 0 in 0.269s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-quobyte-77508d97-eda1-4ced-918d-7bace5b4eef0" released by "_delete_snapshot" :: held 1.665s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-quobyte-32b6e010-c945-4466-a6ba-014c5c610294" released by "delete_snapshot" :: held 1.692s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:21:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Created reservations ['a99b6474-d497-48f1-9130-356ec2da7864', '64245ac4-0015-4456-8c59-263ae29cdb13', '9c5fb2dd-4832-4e38-9a24-ba57479116f5', 'fb1b4e65-12af-4b32-ba7f-1d58b0cca286'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Delete snapshot completed successfully. Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1e24e286-da72-4b7e-81b3-9c65d97123c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-77508d97-eda1-4ced-918d-7bace5b4eef0-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:00 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.328s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:00 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a is being set with open permissions: ugo+rw Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:00 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:22:00 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:00 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "cinder-32b6e010-c945-4466-a6ba-014c5c610294-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:00 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info Jul 27 13:22:00 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-32b6e010-c945-4466-a6ba-014c5c610294-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "cinder-quobyte-32b6e010-c945-4466-a6ba-014c5c610294" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-quobyte-32b6e010-c945-4466-a6ba-014c5c610294" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac808fe-27e7-444c-a16f-77d948dbeaf6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:00 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 Jul 27 13:22:00 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:00 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info" returned: 0 in 0.292s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:00 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info is being set with open permissions: ugo+rw Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:00 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info Jul 27 13:22:00 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:00 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294" returned: 0 in 0.395s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:01 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294 Jul 27 13:22:01 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:01 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.info" returned: 0 in 0.318s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7baae406-2227-4fb8-aaf3-4b18c69023ef tempest-VolumesSnapshotListTestJSON-2107311962 None] Create snapshot completed successfully Jul 27 13:22:01 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-32b6e010-c945-4466-a6ba-014c5c610294" returned: 0 in 0.269s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-quobyte-32b6e010-c945-4466-a6ba-014c5c610294" released by "delete_volume" :: held 0.729s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Created reservations ['06100bf4-00bb-4b93-a153-6f9384531e28', 'b5a9e513-0b17-4365-a1b6-bd6922ad7a47', 'dbf57d82-f355-40b8-ac63-51f80d7ab0eb', '276837ae-b70d-4aa9-869b-508ddaf7a842'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:01 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:01 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:01 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.277s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Deleted volume successfully. Jul 27 13:22:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1da073e1-acb5-43d6-9d61-44a0f77adda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127399506 None] Lock "cinder-32b6e010-c945-4466-a6ba-014c5c610294-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Creating offline snapshot f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 of volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc3e10-c85e-40b1-8d39-b2870b68f6bf]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:02 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:22:02 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:02 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.422s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:02 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 1G Jul 27 13:22:02 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:03 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 1G" returned: 0 in 0.564s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:03 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:03 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:03 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.343s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:03 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 is being set with open permissions: ugo+rw Jul 27 13:22:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:03 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:03 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:03 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.256s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.717s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e4405623-729f-4746-8c42-0aba8113e5ae tempest-VolumesSnapshotListTestJSON-2107311962 None] Create snapshot completed successfully Jul 27 13:22:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Creating offline snapshot c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa of volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:22:04 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe04ad5-d7a3-40e8-abe0-221fc003efb9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:04 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:04 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:05 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.419s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:05 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa 1G Jul 27 13:22:05 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Flow 'volume_create_manager' (a2a3157d-9478-45c5-b232-af079a621f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1454d7-b6ec-41f6-a647-2c68817a5c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1454d7-b6ec-41f6-a647-2c68817a5c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1093091628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ebc0a0-efdf-4927-8b0a-67d00a2a80cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7befbf0b00748c99adb71098a3afb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:05Z,use_quota=True,user_id='b9249222691c46d0ab01bf4ec5d467df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b57f132-869a-4695-a5d5-c1934f2e5dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b57f132-869a-4695-a5d5-c1934f2e5dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e8ea94-4f53-4111-8902-c54d49a408bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e8ea94-4f53-4111-8902-c54d49a408bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'volume_name': 'volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e817e85-dff6-44e1-b497-4625414eb82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e817e85-dff6-44e1-b497-4625414eb82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e631b1fd-8b70-4c65-b1fa-7b42a7e257a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Volume 91ebc0a0-efdf-4927-8b0a-67d00a2a80cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'volume_size': 1} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:05 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa 1G" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:05 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa Jul 27 13:22:05 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:05 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:05 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa is being set with open permissions: ugo+rw Jul 27 13:22:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:05 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa Jul 27 13:22:05 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:06 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" returned: 0 in 0.245s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.669s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1093091628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ebc0a0-efdf-4927-8b0a-67d00a2a80cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7befbf0b00748c99adb71098a3afb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:05Z,use_quota=True,user_id='b9249222691c46d0ab01bf4ec5d467df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Creating volume 91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:06 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:06 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb 1073741824 Jul 27 13:22:06 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8ec6385e-dba8-49ef-8ae6-aaa7222b4268 tempest-VolumesSnapshotListTestJSON-2107311962 None] Create snapshot completed successfully Jul 27 13:22:06 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb 1073741824" returned: 0 in 0.488s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:06 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:06 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:06 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e631b1fd-8b70-4c65-b1fa-7b42a7e257a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a1601f-06c9-4342-8df9-dcb4fba4f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:07 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Volume volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb (91ebc0a0-efdf-4927-8b0a-67d00a2a80cb): created successfully Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a1601f-06c9-4342-8df9-dcb4fba4f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Flow 'volume_create_manager' (a2a3157d-9478-45c5-b232-af079a621f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6d460f81-6da7-42f3-be8a-ae8d25f087b0 tempest-VolumesCloneTest-1740282064 None] Created volume successfully. Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Deleting offline snapshot c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa of volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] snapshot_file for this snap is: volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9058d1d7-e1db-43fe-8a0d-e6d10b690d51]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:07 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa Jul 27 13:22:07 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:07 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" returned: 0 in 0.427s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[74002ab3-460b-4a85-8610-37b28a8150c0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:08 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:08 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Flow 'volume_create_manager' (a27301fc-d73a-4782-a36d-d8b91b634ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ff6b44-6d61-48df-93f2-f18d53f41abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ff6b44-6d61-48df-93f2-f18d53f41abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-181612892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182c32ac-cc01-48f3-ba8c-6b35f375840c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7befbf0b00748c99adb71098a3afb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=91ebc0a0-efdf-4927-8b0a-67d00a2a80cb,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:08Z,use_quota=True,user_id='b9249222691c46d0ab01bf4ec5d467df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2630008-f0e4-4ade-b5b6-bac82ebf858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2630008-f0e4-4ade-b5b6-bac82ebf858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201dcfc4-23df-488f-aef9-13f459541212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201dcfc4-23df-488f-aef9-13f459541212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '182c32ac-cc01-48f3-ba8c-6b35f375840c', 'volume_name': 'volume-182c32ac-cc01-48f3-ba8c-6b35f375840c', 'volume_size': 2, 'source_volid': '91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'source_volstatus': 'available'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:08 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a580cd6a-316f-4285-8b86-cef7565e91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a580cd6a-316f-4285-8b86-cef7565e91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c929c6b0-dda5-40c3-8dbc-5fa080244709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Volume 182c32ac-cc01-48f3-ba8c-6b35f375840c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-182c32ac-cc01-48f3-ba8c-6b35f375840c', 'volume_size': 2, 'source_volid': '91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'source_volstatus': 'available'} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.433s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:08 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa Jul 27 13:22:08 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Cloning volume 91ebc0a0-efdf-4927-8b0a-67d00a2a80cb to volume 182c32ac-cc01-48f3-ba8c-6b35f375840c Jul 27 13:22:08 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Creating offline snapshot 54d706b4-b9ba-4112-9b70-6ef22861ba72 of volume 91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efa415d-a1c1-41e0-bead-965dc11defd4]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:08 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:08 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:08 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" returned: 0 in 0.467s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:08 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa Jul 27 13:22:08 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:08 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.423s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:08 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 1G Jul 27 13:22:08 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:09 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" returned: 0 in 0.276s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa" released by "_delete_snapshot" :: held 1.738s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" released by "delete_snapshot" :: held 1.770s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Created reservations ['a2a0b970-6bb8-41a5-8a33-a1bb798ca57f', '7e99a63a-57b0-4799-bc0d-8fa3a8780154', '5068bf97-6dfd-4c0a-99ca-162c416b3c49', '43d706c6-162c-4be8-afbb-133ab74c89bf'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Delete snapshot completed successfully. Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8a31f51-bab5-49db-b90c-16899c127095 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-c1a6d52f-b9fd-44c0-bf7c-12027a7c83fa-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:09 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 1G" returned: 0 in 0.475s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:09 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 Jul 27 13:22:09 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-f8ee3f1c-5d73-41c9-ae58-ecb90c765da7-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-f8ee3f1c-5d73-41c9-ae58-ecb90c765da7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Deleting offline snapshot f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 of volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] snapshot_file for this snap is: volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:22:09 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72" returned: 0 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:09 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 is being set with open permissions: ugo+rw Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60fadb-0e30-4e40-a246-2cb43e7b042e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:09 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 Jul 27 13:22:09 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:09 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:09 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:10 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72" returned: 0 in 0.267s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:10 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info Jul 27 13:22:10 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:10 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.418s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac1222-6ceb-4335-b48a-8285ac682aac]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:10 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:10 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:22:10 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info" returned: 0 in 0.311s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:10 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info is being set with open permissions: ugo+rw Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:10 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info Jul 27 13:22:10 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:10 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.info" returned: 0 in 0.245s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:10 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Acquiring lock "cinder-quobyte-182c32ac-cc01-48f3-ba8c-6b35f375840c" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.417s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-182c32ac-cc01-48f3-ba8c-6b35f375840c" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] snapshot: 54d706b4-b9ba-4112-9b70-6ef22861ba72, volume: 182c32ac-cc01-48f3-ba8c-6b35f375840c, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:22:10 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:10 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3dd2b-edd2-4696-b288-27cb5d2f1092]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:10 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 Jul 27 13:22:10 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:11 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.397s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:11 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7 Jul 27 13:22:11 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:11 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72" returned: 0 in 0.387s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65a3505-5c91-48df-a492-5b7c1eabbef6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:11 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:11 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:11 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-f8ee3f1c-5d73-41c9-ae58-ecb90c765da7" released by "_delete_snapshot" :: held 1.629s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" released by "delete_snapshot" :: held 1.662s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Created reservations ['f370e099-3617-419d-aa35-3ed244f89d29', '1a027628-0d73-4e65-88e9-39760b3dde54', '6b34e716-1f8c-4875-a479-dc4e35f94c0b', '0b8aee93-ac25-4db3-959c-c172542c5806'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Delete snapshot completed successfully. Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-168b1f53-edc5-4ca2-9733-1dcd030fa30b tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-f8ee3f1c-5d73-41c9-ae58-ecb90c765da7-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:11 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.412s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:11 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c Jul 27 13:22:11 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-40ddcdde-dcef-4d47-bd31-cd1e28b0f65a-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-40ddcdde-dcef-4d47-bd31-cd1e28b0f65a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Deleting offline snapshot 40ddcdde-dcef-4d47-bd31-cd1e28b0f65a of volume 1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] snapshot_file for this snap is: volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecc188c-257b-4934-a309-30aa0914c016]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:12 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:22:12 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:12 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.553s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb81777-8170-4d87-bf46-56da5a01401f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b130c65-abe8-4f7e-9884-a710b9f9b43c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:12 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f Jul 27 13:22:12 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:13 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f" returned: 0 in 0.742s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:13 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:22:13 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:14 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.724s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:14 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a Jul 27 13:22:14 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Flow 'volume_create_manager' (54eba795-06cc-4653-a9c9-2065b0f6f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7a8a2-d234-44b2-99c3-ca7d3b66d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7a8a2-d234-44b2-99c3-ca7d3b66d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1962030703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf56481-4a92-41fd-aeef-5873cce6a0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5f7b7492ae47d081625089130e0b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:14Z,use_quota=True,user_id='36e93b5c6aa643be95a74ef7f0a71175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485114a4-dd7f-4897-998d-41994fa8c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485114a4-dd7f-4897-998d-41994fa8c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7117708f-857c-445a-8851-56069212bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7117708f-857c-445a-8851-56069212bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf56481-4a92-41fd-aeef-5873cce6a0dd', 'volume_name': 'volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d31a24-b966-4b7d-92e8-a02e5482608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d31a24-b966-4b7d-92e8-a02e5482608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ba7b7a-59f7-425d-a45e-04bdc3928400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:14 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Volume dcf56481-4a92-41fd-aeef-5873cce6a0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd', 'volume_size': 1} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:14 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f.40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" returned: 0 in 0.600s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-40ddcdde-dcef-4d47-bd31-cd1e28b0f65a" released by "_delete_snapshot" :: held 2.806s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" released by "delete_snapshot" :: held 2.843s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Created reservations ['6c90b0dd-8d76-4bc5-be10-19ec39345ff4', '7dad9681-371b-4d38-8d27-ea90d0b7f2af', 'be3db2ec-d211-44d5-b96b-21bce3ff6f39', 'b3645e4c-d7da-415f-8f3d-67e656d43f41'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Delete snapshot completed successfully. Jul 27 13:22:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f06c2f90-a744-4d90-9322-6c884c4b2c1f tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-40ddcdde-dcef-4d47-bd31-cd1e28b0f65a-delete_snapshot" released by "delete_snapshot" :: held 3.080s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-1eb81777-8170-4d87-bf46-56da5a01401f-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-1eb81777-8170-4d87-bf46-56da5a01401f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daa6e7d-5f49-4bf4-b616-99fc2c981034]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:16 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f Jul 27 13:22:16 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:16 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f" returned: 0 in 0.675s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:16 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f Jul 27 13:22:16 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:16 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c" returned: 0 in 5.190s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee5718-efb1-478b-b7dc-2cc2d71996bd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:16 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1eb81777-8170-4d87-bf46-56da5a01401f" returned: 0 in 0.305s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-quobyte-1eb81777-8170-4d87-bf46-56da5a01401f" released by "delete_volume" :: held 1.117s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:16 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:16 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:16 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Created reservations ['55fb55c7-d1ba-4ba3-be29-e3f04aa78e23', '5cb9a193-f827-4b8c-8a2b-a88a85104b59', '829033e5-cf48-445a-8847-a453c5c45943', '9152f6a5-07aa-4c7a-9275-6bb13cb1204c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:17 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:17 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:17 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:17 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Deleted volume successfully. Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-52bd341a-0066-4e2a-bde7-7cca7e162143 tempest-VolumesSnapshotListTestJSON-2107311962 None] Lock "cinder-1eb81777-8170-4d87-bf46-56da5a01401f-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:17 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.542s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:22:17 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Converted 1024.00 MB image at 197.26 MB/s Jul 27 13:22:17 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c is being set with open permissions: ugo+rw Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:17 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c Jul 27 13:22:17 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:17 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-182c32ac-cc01-48f3-ba8c-6b35f375840c" released by "_copy_volume_from_snapshot" :: held 6.891s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Acquiring lock "cinder-quobyte-54d706b4-b9ba-4112-9b70-6ef22861ba72" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-54d706b4-b9ba-4112-9b70-6ef22861ba72" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Deleting offline snapshot 54d706b4-b9ba-4112-9b70-6ef22861ba72 of volume 91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] snapshot_file for this snap is: volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a0f7a-d2b2-472b-be25-3c8b34c71efc]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:17 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 Jul 27 13:22:17 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:18 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c595b7-d647-4a56-a5c1-856eb9801569]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:18 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:18 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:18 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:18 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 Jul 27 13:22:18 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:18 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72" returned: 0 in 0.366s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:18 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72 Jul 27 13:22:18 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:19 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb.54d706b4-b9ba-4112-9b70-6ef22861ba72" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-54d706b4-b9ba-4112-9b70-6ef22861ba72" released by "_delete_snapshot" :: held 1.455s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.690s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.528s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1962030703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf56481-4a92-41fd-aeef-5873cce6a0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5f7b7492ae47d081625089130e0b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:14Z,use_quota=True,user_id='36e93b5c6aa643be95a74ef7f0a71175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Creating volume dcf56481-4a92-41fd-aeef-5873cce6a0dd {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:19 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c929c6b0-dda5-40c3-8dbc-5fa080244709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182c32ac-cc01-48f3-ba8c-6b35f375840c', 'volume_size': 2, 'source_volid': '91ebc0a0-efdf-4927-8b0a-67d00a2a80cb', 'source_volstatus': 'available'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:19 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd 1073741824 Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7193754-3cb8-492a-a22d-d913a2ae6caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:19 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:19 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Volume volume-182c32ac-cc01-48f3-ba8c-6b35f375840c (182c32ac-cc01-48f3-ba8c-6b35f375840c): created successfully Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7193754-3cb8-492a-a22d-d913a2ae6caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Flow 'volume_create_manager' (a27301fc-d73a-4782-a36d-d8b91b634ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:19 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cdb49431-e836-473b-a668-738c51cfb03c tempest-VolumesCloneTest-1740282064 None] Created volume successfully. Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "cinder-182c32ac-cc01-48f3-ba8c-6b35f375840c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-182c32ac-cc01-48f3-ba8c-6b35f375840c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "cinder-quobyte-182c32ac-cc01-48f3-ba8c-6b35f375840c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-182c32ac-cc01-48f3-ba8c-6b35f375840c" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f673752-bbae-4f57-b39e-74665ab6d195]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:19 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd 1073741824" returned: 0 in 0.563s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:19 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd Jul 27 13:22:19 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:19 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c Jul 27 13:22:19 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:20 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd" returned: 0 in 0.272s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ba7b7a-59f7-425d-a45e-04bdc3928400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4244373-0db4-4003-ac77-8b385796bd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:20 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Volume volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd (dcf56481-4a92-41fd-aeef-5873cce6a0dd): created successfully Jul 27 13:22:20 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4244373-0db4-4003-ac77-8b385796bd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Flow 'volume_create_manager' (54eba795-06cc-4653-a9c9-2065b0f6f239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c" returned: 0 in 0.392s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:20 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-85d54425-ba8f-436e-8edf-a7d058e0607f tempest-VolumesListAdminTestJSON-945286300 None] Created volume successfully. Jul 27 13:22:20 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c Jul 27 13:22:20 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:20 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-182c32ac-cc01-48f3-ba8c-6b35f375840c" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-182c32ac-cc01-48f3-ba8c-6b35f375840c" released by "delete_volume" :: held 0.692s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Created reservations ['00f94156-c98a-4012-ac69-ba2b8352f1f7', 'e53f2b7a-d52e-45b2-88bb-722df690cc28', 'dec185d2-eb30-4dba-bc70-4c7b2441eee9', '735d7f1b-74e4-41d8-ad54-290be72ae61a'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:20 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:20 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:20 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.278s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:20 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Deleted volume successfully. Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d129f2b-7267-4f80-94da-5409f874aff2 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-182c32ac-cc01-48f3-ba8c-6b35f375840c-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "cinder-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "cinder-quobyte-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0908f5b9-e3cd-4422-9f73-02b3caa1bfbd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:21 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:21 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:21 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.461s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:21 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb Jul 27 13:22:21 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:21 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" returned: 0 in 0.290s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Flow 'volume_create_manager' (4dc51775-9e3d-4d8a-99f8-6598842f8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1740f0d7-2b80-45c2-93fe-7cfda2ab5e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-quobyte-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb" released by "delete_volume" :: held 0.882s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1740f0d7-2b80-45c2-93fe-7cfda2ab5e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1216006621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af514128-6c7b-4818-987a-23f3bb244907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5f7b7492ae47d081625089130e0b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:22Z,use_quota=True,user_id='36e93b5c6aa643be95a74ef7f0a71175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e522bcb-e441-42d5-b540-af939f16bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e522bcb-e441-42d5-b540-af939f16bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0d44db-e70d-4a2b-a3af-fdf3d2701882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0d44db-e70d-4a2b-a3af-fdf3d2701882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af514128-6c7b-4818-987a-23f3bb244907', 'volume_name': 'volume-af514128-6c7b-4818-987a-23f3bb244907', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db8fcb7-1d7d-4272-9689-2b5f005865ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db8fcb7-1d7d-4272-9689-2b5f005865ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13948ddb-4bfb-4c10-b2bc-fad34b6459f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:21 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Volume af514128-6c7b-4818-987a-23f3bb244907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af514128-6c7b-4818-987a-23f3bb244907', 'volume_size': 1} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1216006621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af514128-6c7b-4818-987a-23f3bb244907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5f7b7492ae47d081625089130e0b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:22Z,use_quota=True,user_id='36e93b5c6aa643be95a74ef7f0a71175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Creating volume af514128-6c7b-4818-987a-23f3bb244907 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:21 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:21 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 1073741824 Jul 27 13:22:21 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:21 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Created reservations ['d2dc0712-c784-4188-9a54-3f61ccc10744', '1039b3a4-cbe1-48f2-a2bf-726591d676d7', 'aa6cb1b4-6b3b-47bb-a958-12365b0091c3', 'c6e95140-8030-4664-89bf-a626ec679f67'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:22 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:22 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:22 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.270s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Deleted volume successfully. Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-6bf8a192-3368-4130-b97a-8e5f426d9159 tempest-VolumesCloneTest-1740282064 None] Lock "cinder-91ebc0a0-efdf-4927-8b0a-67d00a2a80cb-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:22 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 1073741824" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:22 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 Jul 27 13:22:22 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:22 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13948ddb-4bfb-4c10-b2bc-fad34b6459f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af514128-6c7b-4818-987a-23f3bb244907', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030c6772-327a-4282-8adc-e748471b93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:22 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Volume volume-af514128-6c7b-4818-987a-23f3bb244907 (af514128-6c7b-4818-987a-23f3bb244907): created successfully Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030c6772-327a-4282-8adc-e748471b93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Flow 'volume_create_manager' (4dc51775-9e3d-4d8a-99f8-6598842f8e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1f609e90-6982-481c-b9a7-d5bf80d3a299 tempest-VolumesListAdminTestJSON-945286300 None] Created volume successfully. Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Flow 'volume_create_manager' (09261565-2c77-4282-8afc-8ddacaa7169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc78e2-7feb-4ee1-9197-3a666155e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc78e2-7feb-4ee1-9197-3a666155e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1482899461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24c0133-d18f-4f32-bcb0-7b5c1ed5e494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5f7b7492ae47d081625089130e0b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:24Z,use_quota=True,user_id='36e93b5c6aa643be95a74ef7f0a71175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9057e549-fa42-4b22-9075-b3b2cb7a1c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9057e549-fa42-4b22-9075-b3b2cb7a1c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50bc7b4-6126-4d62-ae82-5e893fd23617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50bc7b4-6126-4d62-ae82-5e893fd23617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24c0133-d18f-4f32-bcb0-7b5c1ed5e494', 'volume_name': 'volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f0c226-f586-4f27-b846-c53274f2e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f0c226-f586-4f27-b846-c53274f2e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f800efc-2aea-4765-8e96-0c19217c50b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Volume d24c0133-d18f-4f32-bcb0-7b5c1ed5e494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494', 'volume_size': 1} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1482899461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24c0133-d18f-4f32-bcb0-7b5c1ed5e494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5f7b7492ae47d081625089130e0b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:24Z,use_quota=True,user_id='36e93b5c6aa643be95a74ef7f0a71175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Creating volume d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:24 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:24 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 1073741824 Jul 27 13:22:24 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:24 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 1073741824" returned: 0 in 0.512s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:25 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 Jul 27 13:22:25 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:25 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f800efc-2aea-4765-8e96-0c19217c50b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b7bda3-f313-41cd-9fcb-cf43ad83b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Volume volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 (d24c0133-d18f-4f32-bcb0-7b5c1ed5e494): created successfully Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b7bda3-f313-41cd-9fcb-cf43ad83b00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Flow 'volume_create_manager' (09261565-2c77-4282-8afc-8ddacaa7169e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-874b8d2a-0d7d-41c2-851b-e504b5f58ad2 tempest-VolumesListAdminTestJSON-945286300 None] Created volume successfully. Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Flow 'volume_create_manager' (526b9b34-146c-44c2-8bee-34c97da7900f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428964a4-4110-41fc-b5a2-e240288dd0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428964a4-4110-41fc-b5a2-e240288dd0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1469544242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663a5879-6f5d-42ed-85e4-787a451d1d2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd531b411c541b38faca0c4aab2bb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:26Z,use_quota=True,user_id='80b817062df94a1593a5e5fe2c11416a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca32ab7e-cd71-4a65-a137-268a85dc474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca32ab7e-cd71-4a65-a137-268a85dc474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688be075-350b-4a67-b8eb-ec8742574831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688be075-350b-4a67-b8eb-ec8742574831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663a5879-6f5d-42ed-85e4-787a451d1d2d', 'volume_name': 'volume-663a5879-6f5d-42ed-85e4-787a451d1d2d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652ab020-c2f3-4f03-ae57-194b6b7f6b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652ab020-c2f3-4f03-ae57-194b6b7f6b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960b6072-47a9-496e-bbc6-22273f187d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:26 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Volume 663a5879-6f5d-42ed-85e4-787a451d1d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663a5879-6f5d-42ed-85e4-787a451d1d2d', 'volume_size': 1} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1469544242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663a5879-6f5d-42ed-85e4-787a451d1d2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd531b411c541b38faca0c4aab2bb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:26Z,use_quota=True,user_id='80b817062df94a1593a5e5fe2c11416a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Creating volume 663a5879-6f5d-42ed-85e4-787a451d1d2d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:26 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:26 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d 1073741824 Jul 27 13:22:26 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:27 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d 1073741824" returned: 0 in 0.639s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:27 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d Jul 27 13:22:27 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Flow 'volume_create_manager' (487b8894-1cf9-4126-916e-99104354451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96413624-44de-49f5-a1f8-2489560bc62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96413624-44de-49f5-a1f8-2489560bc62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babbeaac-93a6-4696-8b82-246f110d41ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be011d01a8742248ab5a5f499285ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:27Z,use_quota=True,user_id='4860dd1160504c6ab9e998c5074d64c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c73cbf-a599-42b6-a559-ad4676bdb7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c73cbf-a599-42b6-a559-ad4676bdb7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1370a1-e0ad-4b65-9d69-908f2fbfdba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1370a1-e0ad-4b65-9d69-908f2fbfdba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babbeaac-93a6-4696-8b82-246f110d41ff', 'volume_name': 'volume-babbeaac-93a6-4696-8b82-246f110d41ff', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbac8e6-87b9-47e6-a144-ff858769abee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbac8e6-87b9-47e6-a144-ff858769abee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc37bf-0149-4c5b-9631-820635d27dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:27 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Volume babbeaac-93a6-4696-8b82-246f110d41ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babbeaac-93a6-4696-8b82-246f110d41ff', 'volume_size': 1} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:27 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d" returned: 0 in 0.312s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babbeaac-93a6-4696-8b82-246f110d41ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be011d01a8742248ab5a5f499285ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:27Z,use_quota=True,user_id='4860dd1160504c6ab9e998c5074d64c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Creating volume babbeaac-93a6-4696-8b82-246f110d41ff {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:27 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960b6072-47a9-496e-bbc6-22273f187d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663a5879-6f5d-42ed-85e4-787a451d1d2d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:27 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff 1073741824 Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6974120-f5a6-4620-8795-7a66268a37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:27 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:27 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Volume volume-663a5879-6f5d-42ed-85e4-787a451d1d2d (663a5879-6f5d-42ed-85e4-787a451d1d2d): created successfully Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6974120-f5a6-4620-8795-7a66268a37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Flow 'volume_create_manager' (526b9b34-146c-44c2-8bee-34c97da7900f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:27 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0e41892b-e46e-4dd4-841f-5a64de9f2f34 tempest-VolumesListTestJSON-758152248 None] Created volume successfully. Jul 27 13:22:28 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff 1073741824" returned: 0 in 0.530s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:28 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff Jul 27 13:22:28 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:28 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc37bf-0149-4c5b-9631-820635d27dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babbeaac-93a6-4696-8b82-246f110d41ff', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c564bce9-a141-4fc8-b2cf-8701323b4578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:28 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Volume volume-babbeaac-93a6-4696-8b82-246f110d41ff (babbeaac-93a6-4696-8b82-246f110d41ff): created successfully Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c564bce9-a141-4fc8-b2cf-8701323b4578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Flow 'volume_create_manager' (487b8894-1cf9-4126-916e-99104354451c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-575ccb73-0fda-41bc-9d3e-503577fcc84e tempest-VolumesListAdminTestJSON-1686134243 None] Created volume successfully. Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Flow 'volume_create_manager' (5294d09f-44ee-4263-8e62-f40fddf029da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4d8880-500f-4d26-9838-94bc2b5ff565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4d8880-500f-4d26-9838-94bc2b5ff565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-608602137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d7640c-8fa7-48bd-b1a2-76b3beb76976,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd531b411c541b38faca0c4aab2bb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:29Z,use_quota=True,user_id='80b817062df94a1593a5e5fe2c11416a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3efd085-6576-425c-80dd-46a1d1f73585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3efd085-6576-425c-80dd-46a1d1f73585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca3f5d2-4f6c-462d-853a-3c194db75b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca3f5d2-4f6c-462d-853a-3c194db75b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d7640c-8fa7-48bd-b1a2-76b3beb76976', 'volume_name': 'volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3a3d57-daa5-45c3-84bf-89e0434f9193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3a3d57-daa5-45c3-84bf-89e0434f9193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73be7b4b-aee9-4bdd-ae95-9dde49079316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Volume 20d7640c-8fa7-48bd-b1a2-76b3beb76976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976', 'volume_size': 1} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-608602137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d7640c-8fa7-48bd-b1a2-76b3beb76976,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd531b411c541b38faca0c4aab2bb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:29Z,use_quota=True,user_id='80b817062df94a1593a5e5fe2c11416a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Creating volume 20d7640c-8fa7-48bd-b1a2-76b3beb76976 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:29 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:29 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 1073741824 Jul 27 13:22:29 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Acquiring lock "cinder-babbeaac-93a6-4696-8b82-246f110d41ff-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "cinder-babbeaac-93a6-4696-8b82-246f110d41ff-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Acquiring lock "cinder-quobyte-babbeaac-93a6-4696-8b82-246f110d41ff" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "cinder-quobyte-babbeaac-93a6-4696-8b82-246f110d41ff" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "cinder-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e317cf-3b67-4281-9f4e-f17727df5f62]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:30 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "cinder-quobyte-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 1073741824" returned: 0 in 0.760s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-quobyte-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494" acquired by "delete_volume" :: waited 0.047s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:30 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff Jul 27 13:22:30 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb137b5-a1fa-436a-81a8-a09ff0c187a2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:30 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 Jul 27 13:22:30 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:30 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 Jul 27 13:22:30 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:30 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff" returned: 0 in 0.512s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:30 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976" returned: 0 in 0.305s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:30 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff Jul 27 13:22:30 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73be7b4b-aee9-4bdd-ae95-9dde49079316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6aa26-cc40-4a82-9a1a-d3d45f6a3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Volume volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 (20d7640c-8fa7-48bd-b1a2-76b3beb76976): created successfully Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6aa26-cc40-4a82-9a1a-d3d45f6a3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Flow 'volume_create_manager' (5294d09f-44ee-4263-8e62-f40fddf029da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d37e6204-acce-4eeb-99cc-4592d7041813 tempest-VolumesListTestJSON-758152248 None] Created volume successfully. Jul 27 13:22:30 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494" returned: 0 in 0.448s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:30 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494 Jul 27 13:22:30 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:30 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-babbeaac-93a6-4696-8b82-246f110d41ff" returned: 0 in 0.288s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "cinder-quobyte-babbeaac-93a6-4696-8b82-246f110d41ff" released by "delete_volume" :: held 0.880s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=206,cinder:DELETE=16,cinder:INSERT=55,cinder:SELECT=155 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=164,cinder:UPDATE=202,cinder:INSERT=53,cinder:DELETE=21 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Created reservations ['72907478-b596-4ffa-b6c8-bd3b2e7e839d', '1639102f-fab8-4629-b54e-d3e424e39c41', 'd069282c-a306-49e6-8e0f-3343dbfab1d2', '47c775aa-481f-498a-8d06-c6b354654331'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:30 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-quobyte-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494" released by "delete_volume" :: held 0.789s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:30 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:30 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:30 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Created reservations ['af6b83b9-318d-4798-8d83-7af542b5bdee', '27f67d08-b735-41af-84b5-cb6e89152d9e', 'd88f784c-f398-4f1b-908e-cc61961a2387', '33e403e1-4276-44f6-8610-d742ed09ea18'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:31 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:31 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "cinder-af514128-6c7b-4818-987a-23f3bb244907-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-af514128-6c7b-4818-987a-23f3bb244907-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:31 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "cinder-quobyte-af514128-6c7b-4818-987a-23f3bb244907" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.446s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Deleted volume successfully. Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-quobyte-af514128-6c7b-4818-987a-23f3bb244907" acquired by "delete_volume" :: waited 0.041s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db0424f5-7374-424b-84c4-0dd280b1578e tempest-VolumesListAdminTestJSON-1686134243 None] Lock "cinder-babbeaac-93a6-4696-8b82-246f110d41ff-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b7327-2995-4e4b-b598-a42c40216d84]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:31 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.402s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Deleted volume successfully. Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-62187c55-d7c6-48e3-81d1-58d8dcb0eb8a tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-d24c0133-d18f-4f32-bcb0-7b5c1ed5e494-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:31 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 Jul 27 13:22:31 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:31 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907" returned: 0 in 0.425s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:31 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907 Jul 27 13:22:31 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Flow 'volume_create_manager' (b6b317f9-a699-4c79-8535-653e35c2b3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011b0c4a-8706-42e6-8687-8cbf2193e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011b0c4a-8706-42e6-8687-8cbf2193e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-529733583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130d41c0-346c-4303-9132-88723fccb976,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd531b411c541b38faca0c4aab2bb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:32Z,use_quota=True,user_id='80b817062df94a1593a5e5fe2c11416a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62341690-c9ac-4e28-9a21-5292ce7f93bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62341690-c9ac-4e28-9a21-5292ce7f93bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2979df18-02f4-401b-8b80-3fb1c8c033e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2979df18-02f4-401b-8b80-3fb1c8c033e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130d41c0-346c-4303-9132-88723fccb976', 'volume_name': 'volume-130d41c0-346c-4303-9132-88723fccb976', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230e6496-e73a-4bbf-9a10-d96982a949a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230e6496-e73a-4bbf-9a10-d96982a949a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6666d4d0-8b36-4b03-88f7-d947b7c63ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Volume 130d41c0-346c-4303-9132-88723fccb976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130d41c0-346c-4303-9132-88723fccb976', 'volume_size': 1} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-529733583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130d41c0-346c-4303-9132-88723fccb976,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd531b411c541b38faca0c4aab2bb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:32Z,use_quota=True,user_id='80b817062df94a1593a5e5fe2c11416a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Creating volume 130d41c0-346c-4303-9132-88723fccb976 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:32 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:32 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-af514128-6c7b-4818-987a-23f3bb244907" returned: 0 in 0.317s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-quobyte-af514128-6c7b-4818-987a-23f3bb244907" released by "delete_volume" :: held 0.804s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:32 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 1073741824 Jul 27 13:22:32 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Created reservations ['bd0e7c53-a4b5-4c02-8138-0739e5641a74', '016e8fa4-eddd-4548-84cb-9931e9b596d4', '021d7a65-8587-4d52-8e23-2e545fa0f934', '530870da-4a94-4edf-ab50-d3db5522e17b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:32 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:32 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "cinder-dcf56481-4a92-41fd-aeef-5873cce6a0dd-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-dcf56481-4a92-41fd-aeef-5873cce6a0dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "cinder-quobyte-dcf56481-4a92-41fd-aeef-5873cce6a0dd" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-quobyte-dcf56481-4a92-41fd-aeef-5873cce6a0dd" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:32 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20b1038-3d6e-4696-9bac-864795942d35]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:32 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Deleted volume successfully. Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fdab85bf-39a8-4547-b104-91d05a16f1b3 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-af514128-6c7b-4818-987a-23f3bb244907-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:32 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 1073741824" returned: 0 in 0.609s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:32 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd Jul 27 13:22:32 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:32 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 Jul 27 13:22:32 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:33 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6666d4d0-8b36-4b03-88f7-d947b7c63ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130d41c0-346c-4303-9132-88723fccb976', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d8bbcb-9817-41ec-a4c8-a2d4c444ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:33 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd" returned: 0 in 0.444s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:33 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:33 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:33 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Volume volume-130d41c0-346c-4303-9132-88723fccb976 (130d41c0-346c-4303-9132-88723fccb976): created successfully Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d8bbcb-9817-41ec-a4c8-a2d4c444ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Flow 'volume_create_manager' (b6b317f9-a699-4c79-8535-653e35c2b3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:33 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd Jul 27 13:22:33 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1b512b3a-9189-46a6-bb17-915b42f03b47 tempest-VolumesListTestJSON-758152248 None] Created volume successfully. Jul 27 13:22:33 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.283s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:22:33 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dcf56481-4a92-41fd-aeef-5873cce6a0dd" returned: 0 in 0.306s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-quobyte-dcf56481-4a92-41fd-aeef-5873cce6a0dd" released by "delete_volume" :: held 0.799s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Created reservations ['6729af21-c591-4e87-ac1b-6ccfa2302a73', '5160df29-47c7-4357-972a-4051c9318055', '6f80b835-5dd7-495b-b4d2-4d681865cec7', '24466874-093f-4c87-a600-7e60133df9ad'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:33 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:33 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:33 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Deleted volume successfully. Jul 27 13:22:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a0ff9e57-b717-43a1-be63-40100efec854 tempest-VolumesListAdminTestJSON-945286300 None] Lock "cinder-dcf56481-4a92-41fd-aeef-5873cce6a0dd-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "cinder-130d41c0-346c-4303-9132-88723fccb976-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-130d41c0-346c-4303-9132-88723fccb976-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "cinder-quobyte-130d41c0-346c-4303-9132-88723fccb976" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-quobyte-130d41c0-346c-4303-9132-88723fccb976" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b161defd-ee89-4b0c-b485-0a86d2294d89]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:36 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 Jul 27 13:22:36 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:36 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:37 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976 Jul 27 13:22:37 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:37 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-130d41c0-346c-4303-9132-88723fccb976" returned: 0 in 0.400s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-quobyte-130d41c0-346c-4303-9132-88723fccb976" released by "delete_volume" :: held 0.878s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Created reservations ['2efda203-4186-4049-b637-52e7368a14c2', 'aec01e89-e5ae-452c-b40a-c6d1510be94a', '87078e28-4652-4684-ab07-8b164f4e4ec1', '9b52a903-c26d-4e4f-bbf8-240300e65004'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:37 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:37 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:37 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.285s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:37 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Deleted volume successfully. Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a067b41c-d285-4e35-a80c-e31d854c4091 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-130d41c0-346c-4303-9132-88723fccb976-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "cinder-20d7640c-8fa7-48bd-b1a2-76b3beb76976-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-20d7640c-8fa7-48bd-b1a2-76b3beb76976-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "cinder-quobyte-20d7640c-8fa7-48bd-b1a2-76b3beb76976" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-quobyte-20d7640c-8fa7-48bd-b1a2-76b3beb76976" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c60c9-26fc-43ea-a880-b67a92b78876]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:39 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 Jul 27 13:22:39 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:39 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:39 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976 Jul 27 13:22:39 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:39 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-20d7640c-8fa7-48bd-b1a2-76b3beb76976" returned: 0 in 0.272s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-quobyte-20d7640c-8fa7-48bd-b1a2-76b3beb76976" released by "delete_volume" :: held 0.737s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Created reservations ['c7970d59-008e-42c5-b4a1-f58389a41722', '560bd4fc-17e8-45f0-ace8-f6fe94f695ed', '8b091e37-054f-4530-a00c-f2c7c314be83', '0a53f0a7-84f9-46a6-a5f3-1873fb466e1e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:39 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:39 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Acquiring lock "cinder-663a5879-6f5d-42ed-85e4-787a451d1d2d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:40 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.332s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Lock "cinder-663a5879-6f5d-42ed-85e4-787a451d1d2d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Deleted volume successfully. Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-37979067-1791-4787-b96c-7031276c2b76 tempest-VolumesListTestJSON-758152248 None] Lock "cinder-20d7640c-8fa7-48bd-b1a2-76b3beb76976-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Acquiring lock "cinder-quobyte-663a5879-6f5d-42ed-85e4-787a451d1d2d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Lock "cinder-quobyte-663a5879-6f5d-42ed-85e4-787a451d1d2d" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b4174-9344-487d-a5bb-33acbfd1ef70]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:40 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d Jul 27 13:22:40 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:40 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d" returned: 0 in 0.524s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:40 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d Jul 27 13:22:40 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:41 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-663a5879-6f5d-42ed-85e4-787a451d1d2d" returned: 0 in 0.305s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Lock "cinder-quobyte-663a5879-6f5d-42ed-85e4-787a451d1d2d" released by "delete_volume" :: held 0.897s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Created reservations ['5eab8328-ce4e-463e-9f11-e87873c8cc34', '9c5c5f3d-7081-4aa1-b926-0163b1674665', '92209bec-0752-4cff-ba20-c785ba5c7be7', '10d9380a-7b3a-4920-a1d1-be0202fe0e2c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:41 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:22:41 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:41 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.262s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:22:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Deleted volume successfully. Jul 27 13:22:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ccfe4b6f-50a5-4a3c-b3ac-65c988e4d6ba tempest-VolumesListTestJSON-758152248 None] Lock "cinder-663a5879-6f5d-42ed-85e4-787a451d1d2d-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:22:51 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:INSERT=12,cinder:UPDATE=51,cinder:SELECT=35,cinder:DELETE=2 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:22:51 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=33,cinder:INSERT=17,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Flow 'volume_create_manager' (cc5b5416-97bf-4c97-9033-bd96659956f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b4ec3c-4f0e-422c-8cef-ec7e6195e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b4ec3c-4f0e-422c-8cef-ec7e6195e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1570993062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f900baa2-67c4-494e-9ba9-601a3f8c3943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d827cebe0c847a28f447e771426cbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:53Z,use_quota=True,user_id='c7c5f1fa996346829c282bb8567d46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6623bbb1-712e-405a-9f3e-7824f526a51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6623bbb1-712e-405a-9f3e-7824f526a51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f3cd94-1644-4c9d-9242-a349a3877b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f3cd94-1644-4c9d-9242-a349a3877b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f900baa2-67c4-494e-9ba9-601a3f8c3943', 'volume_name': 'volume-f900baa2-67c4-494e-9ba9-601a3f8c3943', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89516eb-2ee4-448e-afeb-3f8ca1c1a728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89516eb-2ee4-448e-afeb-3f8ca1c1a728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e496af8b-a705-4f0f-8495-4f4dafe77de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Volume f900baa2-67c4-494e-9ba9-601a3f8c3943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f900baa2-67c4-494e-9ba9-601a3f8c3943', 'volume_size': 1} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1570993062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f900baa2-67c4-494e-9ba9-601a3f8c3943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d827cebe0c847a28f447e771426cbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:22:53Z,use_quota=True,user_id='c7c5f1fa996346829c282bb8567d46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Creating volume f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:22:53 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:53 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 1073741824 Jul 27 13:22:53 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:53 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 1073741824" returned: 0 in 0.595s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:22:53 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:22:53 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:22:54 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.343s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e496af8b-a705-4f0f-8495-4f4dafe77de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f900baa2-67c4-494e-9ba9-601a3f8c3943', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3b75c5-0f65-4397-9d87-231b97a1bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:22:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Volume volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 (f900baa2-67c4-494e-9ba9-601a3f8c3943): created successfully Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3b75c5-0f65-4397-9d87-231b97a1bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:22:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Flow 'volume_create_manager' (cc5b5416-97bf-4c97-9033-bd96659956f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:22:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-95c3776a-e819-4177-8e63-62b6f09621c4 tempest-VolumesActionsTest-1399460088 None] Created volume successfully. Jul 27 13:23:04 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:23:04 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Flow 'volume_create_manager' (8d2cfdae-3232-4aee-b33c-f0a168583678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced9fa14-79ae-404e-abc4-9b78fe9342bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced9fa14-79ae-404e-abc4-9b78fe9342bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-969832764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0a0495-38ef-4df6-bb5c-5274a3da9d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7756c2ae85744539bd59106a7e708dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:07Z,use_quota=True,user_id='2ec7b0243a5c49d48e91d88fe807a143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cf10a7-1520-4804-9c0f-f8f23d2c4030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cf10a7-1520-4804-9c0f-f8f23d2c4030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c4a74e-feae-4254-bbe7-4204337433a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c4a74e-feae-4254-bbe7-4204337433a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0a0495-38ef-4df6-bb5c-5274a3da9d5e', 'volume_name': 'volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383ef2ed-7675-4f5c-acde-01abd4648a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383ef2ed-7675-4f5c-acde-01abd4648a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ce69c0-ace5-4447-ad25-559f986f7f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:07 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Volume bb0a0495-38ef-4df6-bb5c-5274a3da9d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e', 'volume_size': 1} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-969832764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0a0495-38ef-4df6-bb5c-5274a3da9d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7756c2ae85744539bd59106a7e708dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:07Z,use_quota=True,user_id='2ec7b0243a5c49d48e91d88fe807a143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Creating volume bb0a0495-38ef-4df6-bb5c-5274a3da9d5e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:23:07 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:23:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:07 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e 1073741824 Jul 27 13:23:07 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:08 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e 1073741824" returned: 0 in 0.902s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:08 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e Jul 27 13:23:08 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:08 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e" returned: 0 in 0.329s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ce69c0-ace5-4447-ad25-559f986f7f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4637ffcb-a9cb-41be-ae56-3f99867d722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:08 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Volume volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e (bb0a0495-38ef-4df6-bb5c-5274a3da9d5e): created successfully Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4637ffcb-a9cb-41be-ae56-3f99867d722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:08 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Flow 'volume_create_manager' (8d2cfdae-3232-4aee-b33c-f0a168583678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-39972418-57d4-4cae-9c7f-cfffdd44d10a tempest-TestMinimumBasicScenario-1674051455 None] Created volume successfully. Jul 27 13:23:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aaeedbe8-2765-4bc0-b482-062ecf585d8a tempest-VolumesActionsTest-1399460088 None] Acquiring lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943" by "attach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:23:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aaeedbe8-2765-4bc0-b482-062ecf585d8a tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943" acquired by "attach_volume" :: waited 0.062s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:23:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-aaeedbe8-2765-4bc0-b482-062ecf585d8a tempest-VolumesActionsTest-1399460088 None] Attaching volume f900baa2-67c4-494e-9ba9-601a3f8c3943 to instance a6de13d1-fdf4-4e08-b899-5dcf91d5707c at mountpoint /dev/vdb on host None. Jul 27 13:23:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-aaeedbe8-2765-4bc0-b482-062ecf585d8a tempest-VolumesActionsTest-1399460088 None] Attach volume completed successfully. Jul 27 13:23:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-aaeedbe8-2765-4bc0-b482-062ecf585d8a tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943" released by "attach_volume" :: held 0.284s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:23:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5b71fbd5-d9f4-47c5-be76-f9ed8cd6f72b tempest-VolumesActionsTest-1399460088 None] Acquiring lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-detach_volume" by "detach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:23:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5b71fbd5-d9f4-47c5-be76-f9ed8cd6f72b tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:23:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5b71fbd5-d9f4-47c5-be76-f9ed8cd6f72b tempest-VolumesActionsTest-1399460088 None] Detaching volume f900baa2-67c4-494e-9ba9-601a3f8c3943 from instance a6de13d1-fdf4-4e08-b899-5dcf91d5707c. Jul 27 13:23:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5b71fbd5-d9f4-47c5-be76-f9ed8cd6f72b tempest-VolumesActionsTest-1399460088 None] Detach volume completed successfully. Jul 27 13:23:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5b71fbd5-d9f4-47c5-be76-f9ed8cd6f72b tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-detach_volume" released by "detach_volume" :: held 0.245s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:23:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-28f04fe4-14bb-4d44-bcd6-b9ce408d0519 req-65aaf803-ee6c-4d12-a878-9191b5e2aafd tempest-TestMinimumBasicScenario-1674051455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-28f04fe4-14bb-4d44-bcd6-b9ce408d0519 req-65aaf803-ee6c-4d12-a878-9191b5e2aafd tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-28f04fe4-14bb-4d44-bcd6-b9ce408d0519 req-65aaf803-ee6c-4d12-a878-9191b5e2aafd tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-28f04fe4-14bb-4d44-bcd6-b9ce408d0519 req-65aaf803-ee6c-4d12-a878-9191b5e2aafd tempest-TestMinimumBasicScenario-1674051455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff5100f8-03e2-4a68-a262-96cfc4225745', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:23:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-28f04fe4-14bb-4d44-bcd6-b9ce408d0519 req-65aaf803-ee6c-4d12-a878-9191b5e2aafd tempest-TestMinimumBasicScenario-1674051455 None] attachment_update completed successfully. Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Flow 'volume_create_manager' (f58c3c21-0079-4d63-b487-61fd47978720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6495f12-cb0d-4139-95c8-a32e51aeaec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6495f12-cb0d-4139-95c8-a32e51aeaec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2019143990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b95ce0-f574-4707-981a-3f28267ebbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e499e6af814c26a28e14f39506a34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:21Z,use_quota=True,user_id='21973186109848feb54c5c41aa3da770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce533ca-4cea-4c12-b5e4-096f4325296d),volume_type_id=4ce533ca-4cea-4c12-b5e4-096f4325296d)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c83f29-e505-4eb0-8381-c6e2e7eea656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c83f29-e505-4eb0-8381-c6e2e7eea656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe6bada-38b9-46e9-b341-fdb317dacd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe6bada-38b9-46e9-b341-fdb317dacd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b95ce0-f574-4707-981a-3f28267ebbbc', 'volume_name': 'volume-d3b95ce0-f574-4707-981a-3f28267ebbbc', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e5ff06-cf88-46eb-8d10-3855f8ba458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e5ff06-cf88-46eb-8d10-3855f8ba458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f30c42-fd5d-44e4-9bee-c535479db1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume d3b95ce0-f574-4707-981a-3f28267ebbbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b95ce0-f574-4707-981a-3f28267ebbbc', 'volume_size': 1} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2019143990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b95ce0-f574-4707-981a-3f28267ebbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e499e6af814c26a28e14f39506a34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:21Z,use_quota=True,user_id='21973186109848feb54c5c41aa3da770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce533ca-4cea-4c12-b5e4-096f4325296d),volume_type_id=4ce533ca-4cea-4c12-b5e4-096f4325296d)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Creating volume d3b95ce0-f574-4707-981a-3f28267ebbbc {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:23:21 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:21 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc 1073741824 Jul 27 13:23:21 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Flow 'volume_create_manager' (ef28819d-858a-461d-88de-044cad5b68e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2810b7-58e3-48b4-8e63-588dacf8887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2810b7-58e3-48b4-8e63-588dacf8887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-710490256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e499e6af814c26a28e14f39506a34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:22Z,use_quota=True,user_id='21973186109848feb54c5c41aa3da770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48e4f63d-fb6f-4387-afc9-f27c1124fdda),volume_type_id=48e4f63d-fb6f-4387-afc9-f27c1124fdda)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25e8249-f59a-4172-b1ba-c587a2d0d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25e8249-f59a-4172-b1ba-c587a2d0d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8acd95-76ee-4c10-99c8-0e136e7415b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8acd95-76ee-4c10-99c8-0e136e7415b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e', 'volume_name': 'volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485a71ec-4755-4210-b3e7-627ebdc2def6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485a71ec-4755-4210-b3e7-627ebdc2def6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c6a40f-2710-42d9-b36f-c5c5fa9108a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:21 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume 92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e', 'volume_size': 1} Jul 27 13:23:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:22 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc 1073741824" returned: 0 in 0.799s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:22 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc Jul 27 13:23:22 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:22 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc" returned: 0 in 0.643s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-710490256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e499e6af814c26a28e14f39506a34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:22Z,use_quota=True,user_id='21973186109848feb54c5c41aa3da770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48e4f63d-fb6f-4387-afc9-f27c1124fdda),volume_type_id=48e4f63d-fb6f-4387-afc9-f27c1124fdda)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Creating volume 92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:23:22 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:22 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e 1073741824 Jul 27 13:23:22 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f30c42-fd5d-44e4-9bee-c535479db1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b95ce0-f574-4707-981a-3f28267ebbbc', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006f5b78-f122-4532-b59e-cf2e2f71ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:22 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume volume-d3b95ce0-f574-4707-981a-3f28267ebbbc (d3b95ce0-f574-4707-981a-3f28267ebbbc): created successfully Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006f5b78-f122-4532-b59e-cf2e2f71ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Flow 'volume_create_manager' (f58c3c21-0079-4d63-b487-61fd47978720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4628bdec-435b-4744-b658-abf1081bd0d8 tempest-TestInstancesWithCinderVolumes-1361540548 None] Created volume successfully. Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Flow 'volume_create_manager' (8eca4195-3804-4efb-a403-6837598e4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1eb101-d57e-4c9e-9d6f-f71e6f26877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1eb101-d57e-4c9e-9d6f-f71e6f26877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1523351712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63d29a-9689-4d13-813b-65241c549eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e499e6af814c26a28e14f39506a34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:23Z,use_quota=True,user_id='21973186109848feb54c5c41aa3da770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5733550-f339-427c-af0b-3cb2190a5197),volume_type_id=b5733550-f339-427c-af0b-3cb2190a5197)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2781fcff-3b1a-45af-b7af-84e6f19cc327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2781fcff-3b1a-45af-b7af-84e6f19cc327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c323e0-a90a-42ec-9caa-f39fface45f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:23:23 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e 1073741824" returned: 0 in 1.190s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:24 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e Jul 27 13:23:24 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c323e0-a90a-42ec-9caa-f39fface45f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb63d29a-9689-4d13-813b-65241c549eb1', 'volume_name': 'volume-eb63d29a-9689-4d13-813b-65241c549eb1', 'volume_size': 1, 'image_id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1058456602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03e499e6af814c26a28e14f39506a34f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'created_at': datetime.datetime(2026, 7, 27, 11, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a/file', 'properties': {}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe01c59-647a-4da0-9478-65877304f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe01c59-647a-4da0-9478-65877304f75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21528e5-9e63-4c74-8fac-9226ad4d3d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume eb63d29a-9689-4d13-813b-65241c549eb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb63d29a-9689-4d13-813b-65241c549eb1', 'volume_size': 1, 'image_id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1058456602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03e499e6af814c26a28e14f39506a34f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'created_at': datetime.datetime(2026, 7, 27, 11, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a/file', 'properties': {}}, 'image_service': } Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Trying to clone eb63d29a-9689-4d13-813b-65241c549eb1 from image d99c9dfa-83e8-4c41-82d2-74fcf5b0216a at location (None, [{'url': 'file:///opt/stack/data/glance/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:23:24 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e" returned: 0 in 0.514s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c6a40f-2710-42d9-b36f-c5c5fa9108a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a425bc-d2c6-49a7-92d9-7b34881e6182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e (92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e): created successfully Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a425bc-d2c6-49a7-92d9-7b34881e6182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Flow 'volume_create_manager' (ef28819d-858a-461d-88de-044cad5b68e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b657af5e-73d2-4e99-835c-a8792d1ed6e3 tempest-TestInstancesWithCinderVolumes-1361540548 None] Created volume successfully. Jul 27 13:23:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-49207a68-576b-49b0-b20b-d1287f7f6c78 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943" by "attach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:23:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-49207a68-576b-49b0-b20b-d1287f7f6c78 tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943" acquired by "attach_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:23:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-49207a68-576b-49b0-b20b-d1287f7f6c78 tempest-VolumesActionsTest-1399460088 None] Attaching volume f900baa2-67c4-494e-9ba9-601a3f8c3943 to instance ae77f636-b116-476a-99c3-9b03503477d4 at mountpoint /dev/vdb on host None. Jul 27 13:23:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-49207a68-576b-49b0-b20b-d1287f7f6c78 tempest-VolumesActionsTest-1399460088 None] Attach volume completed successfully. Jul 27 13:23:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-49207a68-576b-49b0-b20b-d1287f7f6c78 tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943" released by "attach_volume" :: held 0.121s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:23:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a94da5da-ec34-4fb9-9b14-8cd2d71b55ac tempest-VolumesActionsTest-1399460088 None] Acquiring lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-detach_volume" by "detach_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:23:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a94da5da-ec34-4fb9-9b14-8cd2d71b55ac tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:23:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a94da5da-ec34-4fb9-9b14-8cd2d71b55ac tempest-VolumesActionsTest-1399460088 None] Detaching volume f900baa2-67c4-494e-9ba9-601a3f8c3943 from instance ae77f636-b116-476a-99c3-9b03503477d4. Jul 27 13:23:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a94da5da-ec34-4fb9-9b14-8cd2d71b55ac tempest-VolumesActionsTest-1399460088 None] Detach volume completed successfully. Jul 27 13:23:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a94da5da-ec34-4fb9-9b14-8cd2d71b55ac tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:23:29 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD, size 20.69 MB, duration 5.59 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:23:29 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Image download 20.69 MB at 3.70 MB/s Jul 27 13:23:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eda27b-5f23-4d87-86ef-30596bdd8952]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:30 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD Jul 27 13:23:30 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:30 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:30 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Temporary image d99c9dfa-83e8-4c41-82d2-74fcf5b0216a is fetched for user 21973186109848feb54c5c41aa3da770. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:23:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0633f569-a42c-4f0f-854e-f8891163ed32]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:30 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD Jul 27 13:23:30 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:30 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1523351712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63d29a-9689-4d13-813b-65241c549eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e499e6af814c26a28e14f39506a34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:23:23Z,use_quota=True,user_id='21973186109848feb54c5c41aa3da770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5733550-f339-427c-af0b-3cb2190a5197),volume_type_id=b5733550-f339-427c-af0b-3cb2190a5197)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Creating volume eb63d29a-9689-4d13-813b-65241c549eb1 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:23:31 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:31 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 1073741824 Jul 27 13:23:31 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:31 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 1073741824" returned: 0 in 0.478s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:31 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 Jul 27 13:23:31 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:31 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Attempting download of d99c9dfa-83e8-4c41-82d2-74fcf5b0216a ((None, [{'url': 'file:///opt/stack/data/glance/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'metadata': {}}])) to volume eb63d29a-9689-4d13-813b-65241c549eb1. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17d4418-fed9-40e6-a28f-f8396d01ddb9]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:32 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1 Jul 27 13:23:32 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:32 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1" returned: 0 in 0.420s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:32 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1 Jul 27 13:23:32 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:32 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1" returned: 1 in 0.391s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_2pr0kda1' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:23:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59655c2-3b7a-4fa5-8ae6-16432402aa3c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:32 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD Jul 27 13:23:32 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:33 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] d99c9dfa-83e8-4c41-82d2-74fcf5b0216a was qcow2, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:33 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:23:33 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:33 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 Jul 27 13:23:33 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:23:33 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.437s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b525f8-5848-4b39-b91b-86353bcb4534]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:23:33 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:23:33 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:33 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.435s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e4db79-e56f-486a-b4b3-6dede5f806ff]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:34 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:23:34 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:34 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.435s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.e0a94a5f-9151-4048-8383-28aa6328cd19um6s9eyd.img {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:34 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.e0a94a5f-9151-4048-8383-28aa6328cd19um6s9eyd.img Jul 27 13:23:34 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:35 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1" returned: 0 in 2.692s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:35 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d99c9dfa-83e8-4c41-82d2-74fcf5b0216a_jzeha7igdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:23:35 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Converted 112.00 MB image at 41.52 MB/s Jul 27 13:23:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:35 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 1G Jul 27 13:23:35 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:36 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 1G" returned: 0 in 1.161s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:36 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Downloaded image d99c9dfa-83e8-4c41-82d2-74fcf5b0216a ((None, [{'url': 'file:///opt/stack/data/glance/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'metadata': {}}])) to volume eb63d29a-9689-4d13-813b-65241c549eb1 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Temporary image d99c9dfa-83e8-4c41-82d2-74fcf5b0216a for user 21973186109848feb54c5c41aa3da770 is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Marking volume eb63d29a-9689-4d13-813b-65241c549eb1 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Copying metadata from image d99c9dfa-83e8-4c41-82d2-74fcf5b0216a to eb63d29a-9689-4d13-813b-65241c549eb1. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Creating volume glance metadata for volume eb63d29a-9689-4d13-813b-65241c549eb1 backed by image d99c9dfa-83e8-4c41-82d2-74fcf5b0216a with: {'image_id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'image_name': 'tempest-scenario-img--1058456602', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21528e5-9e63-4c74-8fac-9226ad4d3d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb63d29a-9689-4d13-813b-65241c549eb1', 'volume_size': 1, 'image_id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1058456602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03e499e6af814c26a28e14f39506a34f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd99c9dfa-83e8-4c41-82d2-74fcf5b0216a', 'created_at': datetime.datetime(2026, 7, 27, 11, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d99c9dfa-83e8-4c41-82d2-74fcf5b0216a/file', 'properties': {}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527bbd8b-838f-4a8e-99cd-ae3228278ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:23:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Volume volume-eb63d29a-9689-4d13-813b-65241c549eb1 (eb63d29a-9689-4d13-813b-65241c549eb1): created successfully Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527bbd8b-838f-4a8e-99cd-ae3228278ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:23:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Flow 'volume_create_manager' (8eca4195-3804-4efb-a403-6837598e4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:23:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-45904453-0cbf-4c78-8677-8f3c718bf03d tempest-TestInstancesWithCinderVolumes-1361540548 None] Created volume successfully. Jul 27 13:23:39 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.e0a94a5f-9151-4048-8383-28aa6328cd19um6s9eyd.img" returned: 0 in 5.215s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:39 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[636087bc-12d6-4a7b-8ddd-a934eee56879]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:23:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:23:39 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:23:39 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:23:40 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 27 13:23:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.622s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:23:40 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.e0a94a5f-9151-4048-8383-28aa6328cd19um6s9eyd.img {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:23:40 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Converted 1024.00 MB image at 196.30 MB/s Jul 27 13:23:40 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] e0a94a5f-9151-4048-8383-28aa6328cd19 was raw, no need to convert to raw {{(pid=88202) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 27 13:23:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-6330a5d3-2e19-4ac1-abe6-e5b5d9b397f4 req-a8c439d3-a500-49a9-9210-3fffe6f75d7e tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:23:51 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=23,cinder:SELECT=34,cinder:INSERT=8 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:23:51 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=38,cinder:INSERT=9,cinder:UPDATE=20,cinder:DELETE=4 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:24:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.510s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Uploaded volume to glance image-id: e0a94a5f-9151-4048-8383-28aa6328cd19. {{(pid=88202) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 27 13:24:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-6330a5d3-2e19-4ac1-abe6-e5b5d9b397f4 req-a8c439d3-a500-49a9-9210-3fffe6f75d7e tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.241s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-6330a5d3-2e19-4ac1-abe6-e5b5d9b397f4 req-a8c439d3-a500-49a9-9210-3fffe6f75d7e tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a53984f6-f8ef-4932-a868-ebe73ae1e2ec tempest-VolumesActionsTest-1399460088 None] Copy volume to image completed successfully. Jul 27 13:24:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-6330a5d3-2e19-4ac1-abe6-e5b5d9b397f4 req-a8c439d3-a500-49a9-9210-3fffe6f75d7e tempest-TestInstancesWithCinderVolumes-1361540548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-eb63d29a-9689-4d13-813b-65241c549eb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcbeb23d-1f96-4e9d-8d74-d0cb8c214ed4', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:24:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-6330a5d3-2e19-4ac1-abe6-e5b5d9b397f4 req-a8c439d3-a500-49a9-9210-3fffe6f75d7e tempest-TestInstancesWithCinderVolumes-1361540548 None] attachment_update completed successfully. Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae227511-77b5-4c21-a290-c2fe64c31d01]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:03 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:24:03 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:03 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.403s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dce846-4d52-4370-bcda-f1f9156abb76]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:03 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:24:03 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:03 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.390s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:03 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img Jul 27 13:24:03 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:10 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img" returned: 0 in 6.750s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a3bd9d-196a-478a-8f73-a86d0f2c87d4]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:10 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:24:10 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:24:11 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.740s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:24:11 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Converted 1024.00 MB image at 151.67 MB/s Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] 3233bdcb-ce33-4250-9c9d-12d4feafd9f8 was raw, converting to qcow2 {{(pid=88202) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5115ebb7-3058-4eab-8068-0ddae197900b]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:11 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img Jul 27 13:24:11 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:11 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img" returned: 0 in 0.468s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:12 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img Jul 27 13:24:12 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:12 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img" returned: 1 in 0.464s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:12 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2 Jul 27 13:24:12 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:12 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2" returned: 0 in 0.339s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Image conversion details: src /opt/stack/data/cinder/conversion/f900baa2-67c4-494e-9ba9-601a3f8c3943.temp_image.3233bdcb-ce33-4250-9c9d-12d4feafd9f8dh8wykty.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:24:12 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1423aaf-da82-4414-956b-0f1014a04166]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:12 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2 Jul 27 13:24:12 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:13 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vw1zv1x2" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-45392523-483a-43bc-9338-cc5c6bab5b9b req-951a419e-1a6c-4402-84bd-ed146eec6ad5 tempest-TestMinimumBasicScenario-1674051455 None] Terminate volume connection completed successfully. Jul 27 13:24:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-45392523-483a-43bc-9338-cc5c6bab5b9b req-951a419e-1a6c-4402-84bd-ed146eec6ad5 tempest-TestMinimumBasicScenario-1674051455 None] Deleting attachment ff5100f8-03e2-4a68-a262-96cfc4225745. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:24:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.833s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Uploaded volume to glance image-id: 3233bdcb-ce33-4250-9c9d-12d4feafd9f8. {{(pid=88202) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 27 13:24:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fc7e320f-c9a1-4557-ba61-2a2c8fb65a31 tempest-VolumesActionsTest-1399460088 None] Copy volume to image completed successfully. Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Acquiring lock "cinder-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Lock "cinder-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Acquiring lock "cinder-quobyte-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Lock "cinder-quobyte-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e" acquired by "delete_volume" :: waited 0.044s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a654406-5f59-4ec0-abd4-115ff6182caf]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:16 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e Jul 27 13:24:16 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "cinder-quobyte-f900baa2-67c4-494e-9ba9-601a3f8c3943" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Lock "cinder-quobyte-f900baa2-67c4-494e-9ba9-601a3f8c3943" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d0b6c-9182-40d4-9945-b6d42a9dc801]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:17 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e" returned: 0 in 0.468s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:17 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:24:17 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e Jul 27 13:24:17 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:17 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:17 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Lock "cinder-quobyte-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e" released by "delete_volume" :: held 0.925s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:17 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.629s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Created reservations ['56f10f4e-9475-43fc-9aed-23fdf62a9448', 'fd5e54e0-de22-4a20-86cd-7724d37b632d', '2aa9c652-c614-4231-8f90-dd51869a1932', '5d8ee6a0-7c0a-47e2-842e-46dc4fce8cd2'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:24:17 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943 Jul 27 13:24:17 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:17 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:17 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:18 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:18 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.280s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f900baa2-67c4-494e-9ba9-601a3f8c3943" returned: 0 in 0.473s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:18 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Deleted volume successfully. Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Lock "cinder-quobyte-f900baa2-67c4-494e-9ba9-601a3f8c3943" released by "delete_volume" :: held 1.165s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-154796b4-ee71-4e3b-b0ef-36ced862f3e0 tempest-TestMinimumBasicScenario-1674051455 None] Lock "cinder-bb0a0495-38ef-4df6-bb5c-5274a3da9d5e-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Created reservations ['1cb6c234-90dd-4187-88dd-71f754986c93', 'b4a09517-4d17-4379-b52b-a5c4d2562cc1', '1dda7fe6-c19b-4f0c-9a08-97e4cb75a530', 'ab4e7fad-fd86-4bb4-914b-a89b297f3ddd'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:18 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:18 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:18 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.256s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:18 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Deleted volume successfully. Jul 27 13:24:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2145f37f-4e4b-444b-8dbd-63f459fca793 tempest-VolumesActionsTest-1399460088 None] Lock "cinder-f900baa2-67c4-494e-9ba9-601a3f8c3943-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:28 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:24:28 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=16,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Flow 'volume_create_manager' (a5e2eb23-1f49-4a52-a0e4-980a24c577ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f6b7a8-4512-4aaa-8f10-640dba4095cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f6b7a8-4512-4aaa-8f10-640dba4095cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-132532721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2314e981-a0b1-4ead-9234-113251bbd79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d2d1bc760b451fbc672bdd42b30b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:24:29Z,use_quota=True,user_id='75af4b9de0a84be690221f58da1ae83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96602c1-785d-4403-812b-abb8b195ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96602c1-785d-4403-812b-abb8b195ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28e68f7-c0a7-4f65-ba8f-d12e1f2359a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28e68f7-c0a7-4f65-ba8f-d12e1f2359a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2314e981-a0b1-4ead-9234-113251bbd79c', 'volume_name': 'volume-2314e981-a0b1-4ead-9234-113251bbd79c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2c7eff-4aca-45f1-8c6f-33ac00463044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2c7eff-4aca-45f1-8c6f-33ac00463044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1593daa9-7e9b-495c-98a0-2ab3007c1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:24:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Volume 2314e981-a0b1-4ead-9234-113251bbd79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2314e981-a0b1-4ead-9234-113251bbd79c', 'volume_size': 1} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-132532721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2314e981-a0b1-4ead-9234-113251bbd79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d2d1bc760b451fbc672bdd42b30b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:24:29Z,use_quota=True,user_id='75af4b9de0a84be690221f58da1ae83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Creating volume 2314e981-a0b1-4ead-9234-113251bbd79c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:24:29 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:24:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:29 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c 1073741824 Jul 27 13:24:29 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:30 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c 1073741824" returned: 0 in 0.577s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:30 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c Jul 27 13:24:30 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:30 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c" returned: 0 in 0.336s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1593daa9-7e9b-495c-98a0-2ab3007c1cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2314e981-a0b1-4ead-9234-113251bbd79c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bac434a-4775-4d5f-8af6-d17be3e843de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:24:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Volume volume-2314e981-a0b1-4ead-9234-113251bbd79c (2314e981-a0b1-4ead-9234-113251bbd79c): created successfully Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bac434a-4775-4d5f-8af6-d17be3e843de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:24:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Flow 'volume_create_manager' (a5e2eb23-1f49-4a52-a0e4-980a24c577ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:24:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d8c9e6c7-e22a-4c61-a2e3-c53473866c50 tempest-VolumesNegativeTest-2045987754 None] Created volume successfully. Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:33 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:33 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc23cc9f-2f05-4dd8-b9d3-eba5c227c610 req-5beeb597-9244-4d7d-9434-cb313345449b tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc23cc9f-2f05-4dd8-b9d3-eba5c227c610 req-5beeb597-9244-4d7d-9434-cb313345449b tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-bc23cc9f-2f05-4dd8-b9d3-eba5c227c610 req-5beeb597-9244-4d7d-9434-cb313345449b tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:33 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.323s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:24:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-bc23cc9f-2f05-4dd8-b9d3-eba5c227c610 req-5beeb597-9244-4d7d-9434-cb313345449b tempest-TestInstancesWithCinderVolumes-1361540548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-d3b95ce0-f574-4707-981a-3f28267ebbbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '054a2030-b71a-4936-9f2e-d0f2c3584fb7', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:24:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-bc23cc9f-2f05-4dd8-b9d3-eba5c227c610 req-5beeb597-9244-4d7d-9434-cb313345449b tempest-TestInstancesWithCinderVolumes-1361540548 None] attachment_update completed successfully. Jul 27 13:24:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-ca8e56b7-ccfe-4693-a730-d29a5fef523a req-cf5fbc87-fe51-40aa-9cb9-bcd2254d986a tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-ca8e56b7-ccfe-4693-a730-d29a5fef523a req-cf5fbc87-fe51-40aa-9cb9-bcd2254d986a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-ca8e56b7-ccfe-4693-a730-d29a5fef523a req-cf5fbc87-fe51-40aa-9cb9-bcd2254d986a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-ca8e56b7-ccfe-4693-a730-d29a5fef523a req-cf5fbc87-fe51-40aa-9cb9-bcd2254d986a tempest-TestInstancesWithCinderVolumes-1361540548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbca05bf-a7b1-4d2c-98d8-e27ba597b319', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:24:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-ca8e56b7-ccfe-4693-a730-d29a5fef523a req-cf5fbc87-fe51-40aa-9cb9-bcd2254d986a tempest-TestInstancesWithCinderVolumes-1361540548 None] attachment_update completed successfully. Jul 27 13:24:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-88e97bf4-e4ba-4227-963f-dbaf27b367ff req-3f892506-de41-4785-8bb2-d4b44d02f110 tempest-TestInstancesWithCinderVolumes-1361540548 None] Terminate volume connection completed successfully. Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-88e97bf4-e4ba-4227-963f-dbaf27b367ff req-3f892506-de41-4785-8bb2-d4b44d02f110 tempest-TestInstancesWithCinderVolumes-1361540548 None] Deleting attachment 054a2030-b71a-4936-9f2e-d0f2c3584fb7. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "cinder-d3b95ce0-f574-4707-981a-3f28267ebbbc-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-d3b95ce0-f574-4707-981a-3f28267ebbbc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "cinder-quobyte-d3b95ce0-f574-4707-981a-3f28267ebbbc" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-quobyte-d3b95ce0-f574-4707-981a-3f28267ebbbc" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7424b2-13ff-4aa5-b585-4f90f23cea5d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:45 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc Jul 27 13:24:45 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:45 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc" returned: 0 in 0.460s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:45 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc Jul 27 13:24:45 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:45 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d3b95ce0-f574-4707-981a-3f28267ebbbc" returned: 0 in 0.355s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-quobyte-d3b95ce0-f574-4707-981a-3f28267ebbbc" released by "delete_volume" :: held 0.880s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:45 devstack cinder-volume[88202]: WARNING cinder.quota [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1088704615-1740682290 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1088704615-1740682290, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:24:45 devstack cinder-volume[88202]: WARNING cinder.quota [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1088704615-1740682290 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1088704615-1740682290, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Created reservations ['2ca8ed03-58b1-4dfc-a560-7d9020989eb7', 'f0efb7b9-9eb2-484a-b34a-cafeffbf1d9d', 'c8f36e08-7a4a-48a1-8887-d415e4355e09', '22c43f58-a34c-4e0d-bb4b-95a3ef8105bc'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:45 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:45 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:46 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:46 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Deleted volume successfully. Jul 27 13:24:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-43017549-448f-4f5b-8e73-118690bc9ee1 tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-d3b95ce0-f574-4707-981a-3f28267ebbbc-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-a7f40b50-b318-4634-b352-dfdacb9d437f req-c18c70c7-92fb-4a39-8aa9-915cd4b72d43 tempest-TestInstancesWithCinderVolumes-1361540548 None] Terminate volume connection completed successfully. Jul 27 13:24:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-a7f40b50-b318-4634-b352-dfdacb9d437f req-c18c70c7-92fb-4a39-8aa9-915cd4b72d43 tempest-TestInstancesWithCinderVolumes-1361540548 None] Deleting attachment bbca05bf-a7b1-4d2c-98d8-e27ba597b319. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "cinder-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "cinder-quobyte-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-quobyte-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e32204-a6bf-4dce-906b-9fa7bdc5f13f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:50 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e Jul 27 13:24:50 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:50 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e" returned: 0 in 0.530s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:50 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e Jul 27 13:24:50 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:51 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e" returned: 0 in 0.357s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-quobyte-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e" released by "delete_volume" :: held 0.962s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:51 devstack cinder-volume[88202]: WARNING cinder.quota [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-968713931-1350066332 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-968713931-1350066332, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:24:51 devstack cinder-volume[88202]: WARNING cinder.quota [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-968713931-1350066332 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-968713931-1350066332, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Created reservations ['3ad944d3-df46-4655-8c87-8af3c3e21dce', '751f34f6-680b-4749-b12f-ae811c5af22b', 'c9d3e6ec-8eeb-4c91-8a35-15a52140b71c', '8f523c24-9058-446c-b55f-95a81c2b26cb'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:51 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:51 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:51 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.626s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:51 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Deleted volume successfully. Jul 27 13:24:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0d23cebf-8b59-45bb-b0e0-517e8252eb6c tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-92ec910c-2b6c-4a1e-a4dc-3a67a7d7537e-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Acquiring lock "cinder-2314e981-a0b1-4ead-9234-113251bbd79c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Lock "cinder-2314e981-a0b1-4ead-9234-113251bbd79c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Acquiring lock "cinder-quobyte-2314e981-a0b1-4ead-9234-113251bbd79c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Lock "cinder-quobyte-2314e981-a0b1-4ead-9234-113251bbd79c" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b74941e-91c3-4e6c-8cb4-14c03c59d176]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:53 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c Jul 27 13:24:53 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:53 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c" returned: 0 in 0.505s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:53 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c Jul 27 13:24:53 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:53 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-2314e981-a0b1-4ead-9234-113251bbd79c" returned: 0 in 0.397s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Lock "cinder-quobyte-2314e981-a0b1-4ead-9234-113251bbd79c" released by "delete_volume" :: held 0.998s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Created reservations ['7d7b1024-b941-48ad-9887-49b22a3212ef', 'c3831b0f-a543-4546-a1d2-0e36b03722be', '536826ab-4c7c-4d93-92a4-c8daa073ba8a', '15f55c68-6b10-4805-bab3-f7836bcbd359'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:54 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:54 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:54 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.307s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Deleted volume successfully. Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-45ead8a4-133d-485c-a6c5-5d8532670c82 tempest-VolumesNegativeTest-2045987754 None] Lock "cinder-2314e981-a0b1-4ead-9234-113251bbd79c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-f486bff7-be48-429f-9ec1-3fa3959b4b43 req-7595e513-d90b-40d7-a698-934a35c79c31 tempest-TestInstancesWithCinderVolumes-1361540548 None] Terminate volume connection completed successfully. Jul 27 13:24:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-f486bff7-be48-429f-9ec1-3fa3959b4b43 req-7595e513-d90b-40d7-a698-934a35c79c31 tempest-TestInstancesWithCinderVolumes-1361540548 None] Deleting attachment bcbeb23d-1f96-4e9d-8d74-d0cb8c214ed4. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:24:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "cinder-eb63d29a-9689-4d13-813b-65241c549eb1-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-eb63d29a-9689-4d13-813b-65241c549eb1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "cinder-quobyte-eb63d29a-9689-4d13-813b-65241c549eb1" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-quobyte-eb63d29a-9689-4d13-813b-65241c549eb1" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604911c-bcd9-46c1-9332-bc754ea973d3]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:56 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 Jul 27 13:24:56 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:56 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1" returned: 0 in 0.434s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:56 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1 Jul 27 13:24:56 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:56 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-eb63d29a-9689-4d13-813b-65241c549eb1" returned: 0 in 0.282s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-quobyte-eb63d29a-9689-4d13-813b-65241c549eb1" released by "delete_volume" :: held 0.778s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:24:56 devstack cinder-volume[88202]: WARNING cinder.quota [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872977884-28927766 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872977884-28927766, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:24:56 devstack cinder-volume[88202]: WARNING cinder.quota [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872977884-28927766 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872977884-28927766, it is now deprecated. Please use the default quota class for default quota. Jul 27 13:24:56 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Created reservations ['36e27088-6d04-4ae8-8a9a-fc0ea2313557', '9c0001aa-2b14-42e5-9009-b98ab8e7e0cc', '7a757301-7093-4dff-a3ad-536a485b8fb4', 'b89c9b40-c2aa-42e3-966a-6f0a7e839889'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:24:57 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:24:57 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:24:57 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:24:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Deleted volume successfully. Jul 27 13:24:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a698d6ce-8171-4069-aa68-bd6756bdcd0a tempest-TestInstancesWithCinderVolumes-1361540548 None] Lock "cinder-eb63d29a-9689-4d13-813b-65241c549eb1-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:25:07 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=36,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=9 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:25:07 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=40,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Flow 'volume_create_manager' (2b9d8e1d-7d0f-4588-b925-012c0af30660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a98937-186a-4b21-b1f9-ea3c1a8eb763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a98937-186a-4b21-b1f9-ea3c1a8eb763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-755119807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add2dd6a-1edf-4d8d-bc54-baf0db7aab74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbc6a60afa04cb1bc77181cf6db9f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:25:11Z,use_quota=True,user_id='a4d21a8941c44e22a16a5718744eac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de67a59-29d3-4b2d-bad2-65d58f63720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de67a59-29d3-4b2d-bad2-65d58f63720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da029883-2c1d-41eb-b6f4-7ddd0275dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da029883-2c1d-41eb-b6f4-7ddd0275dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add2dd6a-1edf-4d8d-bc54-baf0db7aab74', 'volume_name': 'volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9c86db-bd63-4bfc-9fb5-1837a021178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9c86db-bd63-4bfc-9fb5-1837a021178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32638bbf-c365-4162-8652-9bfc6e6a092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:11 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Volume add2dd6a-1edf-4d8d-bc54-baf0db7aab74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74', 'volume_size': 1} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-755119807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add2dd6a-1edf-4d8d-bc54-baf0db7aab74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbc6a60afa04cb1bc77181cf6db9f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:25:11Z,use_quota=True,user_id='a4d21a8941c44e22a16a5718744eac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Creating volume add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:25:11 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:25:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:11 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 1073741824 Jul 27 13:25:11 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:12 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 1073741824" returned: 0 in 0.569s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:12 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:25:12 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:12 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.329s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32638bbf-c365-4162-8652-9bfc6e6a092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95713f27-2e53-4b63-a554-939b2b6527a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:12 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Volume volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 (add2dd6a-1edf-4d8d-bc54-baf0db7aab74): created successfully Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95713f27-2e53-4b63-a554-939b2b6527a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:12 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Flow 'volume_create_manager' (2b9d8e1d-7d0f-4588-b925-012c0af30660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:25:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8a4e2d62-c14f-489e-b2e2-16522dd494d1 tempest-TestStampPattern-1013379530 None] Created volume successfully. Jul 27 13:25:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:25:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:33 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:25:33 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:33 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:25:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Flow 'volume_create_manager' (7b89b40e-22e1-4431-b0cd-0c4c0d1ab79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d822059-ea03-4e64-93fc-01c9b1dc531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d822059-ea03-4e64-93fc-01c9b1dc531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1202377446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c872c9-e260-47cf-a785-5a5d711b39e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc345c210d6d462fb25f1fde077b19a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:25:49Z,use_quota=True,user_id='b91f64b7638148b79baa99fadb9b1a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3220596-9ef0-4544-9725-f5c8dc522e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3220596-9ef0-4544-9725-f5c8dc522e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3367ec62-d6dc-4e60-9117-4e2492c2731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3367ec62-d6dc-4e60-9117-4e2492c2731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2c872c9-e260-47cf-a785-5a5d711b39e8', 'volume_name': 'volume-d2c872c9-e260-47cf-a785-5a5d711b39e8', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d13f3f-2d7c-41ea-a4be-4ad8df1f9080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d13f3f-2d7c-41ea-a4be-4ad8df1f9080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7c1bf5-68ec-403f-a851-90606cbe9dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:49 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Volume d2c872c9-e260-47cf-a785-5a5d711b39e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2c872c9-e260-47cf-a785-5a5d711b39e8', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Trying to clone d2c872c9-e260-47cf-a785-5a5d711b39e8 from image d5827fb8-683b-418e-8e22-9911b3a6a38f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:25:49 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Image download 20.69 MB at 20.69 MB/s Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c000c5d4-2e5c-4a98-9577-ea8704c48e39]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:25:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:49 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD Jul 27 13:25:49 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:50 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f is fetched for user b91f64b7638148b79baa99fadb9b1a18. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb22240-2c7c-43e7-ac32-7c0029774d91]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:50 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD Jul 27 13:25:50 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:50 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1202377446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c872c9-e260-47cf-a785-5a5d711b39e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc345c210d6d462fb25f1fde077b19a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:25:49Z,use_quota=True,user_id='b91f64b7638148b79baa99fadb9b1a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Creating volume d2c872c9-e260-47cf-a785-5a5d711b39e8 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:25:50 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:25:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:50 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 1073741824 Jul 27 13:25:50 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:51 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 1073741824" returned: 0 in 0.530s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:51 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 Jul 27 13:25:51 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:51 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8" returned: 0 in 0.295s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Attempting download of d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume d2c872c9-e260-47cf-a785-5a5d711b39e8. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b9a2c-3407-488f-b1d5-3c280bd2545e]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:51 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7 Jul 27 13:25:51 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-ee73b20b-4ac3-4129-863b-24821ab77664 req-d8213364-ee8e-4dbd-9478-c13b4735d97c tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-ee73b20b-4ac3-4129-863b-24821ab77664 req-d8213364-ee8e-4dbd-9478-c13b4735d97c tempest-TestStampPattern-1013379530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-ee73b20b-4ac3-4129-863b-24821ab77664 req-d8213364-ee8e-4dbd-9478-c13b4735d97c tempest-TestStampPattern-1013379530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-ee73b20b-4ac3-4129-863b-24821ab77664 req-d8213364-ee8e-4dbd-9478-c13b4735d97c tempest-TestStampPattern-1013379530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f86cae09-6e56-4934-8153-c3884e4a3b45', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:25:51 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-ee73b20b-4ac3-4129-863b-24821ab77664 req-d8213364-ee8e-4dbd-9478-c13b4735d97c tempest-TestStampPattern-1013379530 None] attachment_update completed successfully. Jul 27 13:25:51 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7" returned: 0 in 0.363s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:52 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7 Jul 27 13:25:52 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:52 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7" returned: 1 in 0.395s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5827fb8-683b-418e-8e22-9911b3a6a38f_nuqs3re7' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0220ce1-4b82-4bcd-be03-47b608009221]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:52 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD Jul 27 13:25:52 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:52 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] d5827fb8-683b-418e-8e22-9911b3a6a38f was qcow2, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:25:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:52 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 Jul 27 13:25:52 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:54 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8" returned: 0 in 1.663s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5827fb8-683b-418e-8e22-9911b3a6a38f_oj0hj28bdevstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:25:54 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Converted 112.00 MB image at 67.27 MB/s Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:54 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 1G Jul 27 13:25:54 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:54 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 1G" returned: 0 in 0.325s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Downloaded image d5827fb8-683b-418e-8e22-9911b3a6a38f ((None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}])) to volume d2c872c9-e260-47cf-a785-5a5d711b39e8 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Temporary image d5827fb8-683b-418e-8e22-9911b3a6a38f for user b91f64b7638148b79baa99fadb9b1a18 is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Marking volume d2c872c9-e260-47cf-a785-5a5d711b39e8 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Copying metadata from image d5827fb8-683b-418e-8e22-9911b3a6a38f to d2c872c9-e260-47cf-a785-5a5d711b39e8. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Creating volume glance metadata for volume d2c872c9-e260-47cf-a785-5a5d711b39e8 backed by image d5827fb8-683b-418e-8e22-9911b3a6a38f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7c1bf5-68ec-403f-a851-90606cbe9dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c872c9-e260-47cf-a785-5a5d711b39e8', 'volume_size': 1, 'image_id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5827fb8-683b-418e-8e22-9911b3a6a38f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a1d3591e6254cf882258007a3d4554a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5827fb8-683b-418e-8e22-9911b3a6a38f', 'created_at': datetime.datetime(2026, 7, 27, 11, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5827fb8-683b-418e-8e22-9911b3a6a38f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9fb1fb-5dc2-4b12-af4d-cf921852e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:25:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Volume volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 (d2c872c9-e260-47cf-a785-5a5d711b39e8): created successfully Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9fb1fb-5dc2-4b12-af4d-cf921852e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:25:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Flow 'volume_create_manager' (7b89b40e-22e1-4431-b0cd-0c4c0d1ab79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:25:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b357d36f-9d9c-4862-950c-4be309cde3dd tempest-TestShelveInstance-1848976883 None] Created volume successfully. Jul 27 13:25:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-e1abc5b1-ddf8-49ae-a765-0d6f518f5689 req-51d37ccb-6028-4e07-9bb0-a5e71bb89bf7 tempest-TestStampPattern-1013379530 None] Terminate volume connection completed successfully. Jul 27 13:25:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-e1abc5b1-ddf8-49ae-a765-0d6f518f5689 req-51d37ccb-6028-4e07-9bb0-a5e71bb89bf7 tempest-TestStampPattern-1013379530 None] Deleting attachment f86cae09-6e56-4934-8153-c3884e4a3b45. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:25:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-22a311c1-dfd8-47bb-87e8-0eb0d781338e req-3fa0a029-aabf-41f6-b81e-ef61b77bed9f tempest-TestShelveInstance-1848976883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-22a311c1-dfd8-47bb-87e8-0eb0d781338e req-3fa0a029-aabf-41f6-b81e-ef61b77bed9f tempest-TestShelveInstance-1848976883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-22a311c1-dfd8-47bb-87e8-0eb0d781338e req-3fa0a029-aabf-41f6-b81e-ef61b77bed9f tempest-TestShelveInstance-1848976883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:25:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-22a311c1-dfd8-47bb-87e8-0eb0d781338e req-3fa0a029-aabf-41f6-b81e-ef61b77bed9f tempest-TestShelveInstance-1848976883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-d2c872c9-e260-47cf-a785-5a5d711b39e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a96098f-4a5e-4438-8dc5-b9c76601b3bf', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:25:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-22a311c1-dfd8-47bb-87e8-0eb0d781338e req-3fa0a029-aabf-41f6-b81e-ef61b77bed9f tempest-TestShelveInstance-1848976883 None] attachment_update completed successfully. Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Creating offline snapshot 8fa2ed10-b51e-4180-847e-cec4e0941f91 of volume add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ea75a-8078-4e60-bf3a-d78b05b6876c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:58 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:25:58 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:58 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.486s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:58 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 1G Jul 27 13:25:58 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:59 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 1G" returned: 0 in 0.491s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:59 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 Jul 27 13:25:59 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:59 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91" returned: 0 in 0.354s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:59 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 is being set with open permissions: ugo+rw Jul 27 13:25:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:25:59 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 Jul 27 13:25:59 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:25:59 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 27 13:25:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91" returned: 0 in 0.321s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:25:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:00 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info Jul 27 13:26:00 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:00 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info" returned: 0 in 0.319s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:00 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info is being set with open permissions: ugo+rw Jul 27 13:26:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:00 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info Jul 27 13:26:00 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:00 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.info" returned: 0 in 0.505s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-da245f5a-16db-4050-a169-739aa6bfafb1 tempest-TestStampPattern-1013379530 None] Create snapshot completed successfully Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Flow 'volume_create_manager' (d274dc0b-6c86-4b00-ad2a-25d084588713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa03f966-df88-4952-8770-b01ee0a04220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa03f966-df88-4952-8770-b01ee0a04220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1166487117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9658a0b-d9ec-42e3-a02a-420363c6721e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99939df18bde4a9399e069d347466204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:03Z,use_quota=True,user_id='5fa52b30d3084a6699c8b18116cde359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91df5199-733a-43a1-a1e1-b4bc8547e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91df5199-733a-43a1-a1e1-b4bc8547e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f958401c-7754-49f6-beb0-e1fa5f294bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f958401c-7754-49f6-beb0-e1fa5f294bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9658a0b-d9ec-42e3-a02a-420363c6721e', 'volume_name': 'volume-d9658a0b-d9ec-42e3-a02a-420363c6721e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341efff0-bad3-4720-bdb9-c04947b0ec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341efff0-bad3-4720-bdb9-c04947b0ec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01acdd33-7d45-434c-8551-55d2337034f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Volume d9658a0b-d9ec-42e3-a02a-420363c6721e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9658a0b-d9ec-42e3-a02a-420363c6721e', 'volume_size': 1} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1166487117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9658a0b-d9ec-42e3-a02a-420363c6721e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99939df18bde4a9399e069d347466204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:03Z,use_quota=True,user_id='5fa52b30d3084a6699c8b18116cde359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Creating volume d9658a0b-d9ec-42e3-a02a-420363c6721e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:26:03 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:26:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:03 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e 1073741824 Jul 27 13:26:03 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:04 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e 1073741824" returned: 0 in 0.729s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:04 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e Jul 27 13:26:04 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:04 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e" returned: 0 in 0.338s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01acdd33-7d45-434c-8551-55d2337034f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9658a0b-d9ec-42e3-a02a-420363c6721e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3928a285-1c54-448e-af93-13cbd5d558b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Volume volume-d9658a0b-d9ec-42e3-a02a-420363c6721e (d9658a0b-d9ec-42e3-a02a-420363c6721e): created successfully Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3928a285-1c54-448e-af93-13cbd5d558b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Flow 'volume_create_manager' (d274dc0b-6c86-4b00-ad2a-25d084588713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-aab65672-4593-4680-b5d1-6bbc9eac2b59 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Created volume successfully. Jul 27 13:26:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-7e8cf54b-4e2b-46ec-b809-bc49f6b0ca20 req-be9c5805-67d2-469c-857b-b6c57efaaf27 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-7e8cf54b-4e2b-46ec-b809-bc49f6b0ca20 req-be9c5805-67d2-469c-857b-b6c57efaaf27 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-7e8cf54b-4e2b-46ec-b809-bc49f6b0ca20 req-be9c5805-67d2-469c-857b-b6c57efaaf27 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-7e8cf54b-4e2b-46ec-b809-bc49f6b0ca20 req-be9c5805-67d2-469c-857b-b6c57efaaf27 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-d9658a0b-d9ec-42e3-a02a-420363c6721e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '557aae3a-fafb-4f6f-8047-8fd6b6aa3017', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:26:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-7e8cf54b-4e2b-46ec-b809-bc49f6b0ca20 req-be9c5805-67d2-469c-857b-b6c57efaaf27 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] attachment_update completed successfully. Jul 27 13:26:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-26134880-24d6-40ab-b0c4-bc66a4bfbd4d req-e11c4ad5-9a36-4dfc-9b0e-df3ee3029271 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Terminate volume connection completed successfully. Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-26134880-24d6-40ab-b0c4-bc66a4bfbd4d req-e11c4ad5-9a36-4dfc-9b0e-df3ee3029271 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Deleting attachment 557aae3a-fafb-4f6f-8047-8fd6b6aa3017. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Flow 'volume_create_manager' (1ff6422b-f0f0-4b0a-91bb-1f142b65083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099a598d-5bb6-4b40-a53e-703d72b02455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099a598d-5bb6-4b40-a53e-703d72b02455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-671549385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eafad7-d4d3-401c-886f-400c6320f769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbc6a60afa04cb1bc77181cf6db9f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fa2ed10-b51e-4180-847e-cec4e0941f91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:11Z,use_quota=True,user_id='a4d21a8941c44e22a16a5718744eac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0126a1-4c90-4dd3-abfb-8e8effb2bbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0126a1-4c90-4dd3-abfb-8e8effb2bbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d9885-df55-425c-bc03-5d64be5a25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d9885-df55-425c-bc03-5d64be5a25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34eafad7-d4d3-401c-886f-400c6320f769', 'volume_name': 'volume-34eafad7-d4d3-401c-886f-400c6320f769', 'volume_size': 1, 'snapshot_id': '8fa2ed10-b51e-4180-847e-cec4e0941f91'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a5bc03-d095-4572-a6a6-63c226f01d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a5bc03-d095-4572-a6a6-63c226f01d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab6245a-ff9d-4869-951b-54e42eea6e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Volume 34eafad7-d4d3-401c-886f-400c6320f769: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34eafad7-d4d3-401c-886f-400c6320f769', 'volume_size': 1, 'snapshot_id': '8fa2ed10-b51e-4180-847e-cec4e0941f91'} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-quobyte-8fa2ed10-b51e-4180-847e-cec4e0941f91-34eafad7-d4d3-401c-886f-400c6320f769" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-8fa2ed10-b51e-4180-847e-cec4e0941f91-34eafad7-d4d3-401c-886f-400c6320f769" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Creating volume 34eafad7-d4d3-401c-886f-400c6320f769 from snapshot 8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-quobyte-34eafad7-d4d3-401c-886f-400c6320f769" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-34eafad7-d4d3-401c-886f-400c6320f769" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:26:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] snapshot: 8fa2ed10-b51e-4180-847e-cec4e0941f91, volume: 34eafad7-d4d3-401c-886f-400c6320f769, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7846ae3a-e534-428f-8e4c-4bb4fd4479db]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:11 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 Jul 27 13:26:11 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Acquiring lock "cinder-d9658a0b-d9ec-42e3-a02a-420363c6721e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "cinder-d9658a0b-d9ec-42e3-a02a-420363c6721e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Acquiring lock "cinder-quobyte-d9658a0b-d9ec-42e3-a02a-420363c6721e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "cinder-quobyte-d9658a0b-d9ec-42e3-a02a-420363c6721e" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5196289-2f8f-4f30-9836-b44518e6166e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:11 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91" returned: 0 in 0.530s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b1dbe-5c87-4112-9c62-caef7875da49]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:26:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:11 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e Jul 27 13:26:11 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:11 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:26:11 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:12 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e" returned: 0 in 0.556s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:12 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e Jul 27 13:26:12 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:12 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.532s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:12 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 Jul 27 13:26:12 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:12 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d9658a0b-d9ec-42e3-a02a-420363c6721e" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "cinder-quobyte-d9658a0b-d9ec-42e3-a02a-420363c6721e" released by "delete_volume" :: held 0.995s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Created reservations ['9b9b6386-486c-40f2-aa46-da9bea46bb23', 'e181e654-b811-4410-b91e-47d18c40434a', '4869f117-8202-4f50-9355-c5e72e209fbd', '3ab62b78-928a-45d4-81d6-1227b0de7f92'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:12 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:26:12 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:12 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.375s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:13 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:26:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Deleted volume successfully. Jul 27 13:26:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-492c71db-d326-4119-934f-380cde0485a4 tempest-TestServerVolumeAttachScenarioOldVersion-560242467 None] Lock "cinder-d9658a0b-d9ec-42e3-a02a-420363c6721e-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:26:21 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769" returned: 0 in 8.868s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:21 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb7ac7-3fd7-44d8-8053-8e08be0758f3]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:26:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:21 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:26:21 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:21 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.888s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:21 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:26:21 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Converted 1024.00 MB image at 115.45 MB/s Jul 27 13:26:21 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 is being set with open permissions: ugo+rw Jul 27 13:26:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:21 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 Jul 27 13:26:21 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:22 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769" returned: 0 in 0.437s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-34eafad7-d4d3-401c-886f-400c6320f769" released by "_copy_volume_from_snapshot" :: held 11.382s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-8fa2ed10-b51e-4180-847e-cec4e0941f91-34eafad7-d4d3-401c-886f-400c6320f769" released by "_create_volume_from_snapshot" :: held 11.422s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.446s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab6245a-ff9d-4869-951b-54e42eea6e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34eafad7-d4d3-401c-886f-400c6320f769', 'volume_size': 1, 'snapshot_id': '8fa2ed10-b51e-4180-847e-cec4e0941f91'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2262c68-971a-453b-ae60-2a59138554c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:22 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Volume volume-34eafad7-d4d3-401c-886f-400c6320f769 (34eafad7-d4d3-401c-886f-400c6320f769): created successfully Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2262c68-971a-453b-ae60-2a59138554c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Flow 'volume_create_manager' (1ff6422b-f0f0-4b0a-91bb-1f142b65083a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7c6c5892-592e-43bc-8250-5b67eb843c56 tempest-TestStampPattern-1013379530 None] Created volume successfully. Jul 27 13:26:32 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=46,cinder:INSERT=12,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:26:32 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=27,cinder:INSERT=8,cinder:SELECT=42,cinder:DELETE=3 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:33 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:26:33 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:33 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.355s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:26:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:26:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-5ce22308-e8ac-4963-9aff-b2fb4a7cba1a req-e5c39313-7366-4ed0-b6e6-6d8f716bf9e6 tempest-TestShelveInstance-1848976883 None] Terminate volume connection completed successfully. Jul 27 13:26:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-5ce22308-e8ac-4963-9aff-b2fb4a7cba1a req-e5c39313-7366-4ed0-b6e6-6d8f716bf9e6 tempest-TestShelveInstance-1848976883 None] Deleting attachment 2a96098f-4a5e-4438-8dc5-b9c76601b3bf. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:26:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-afec4e98-556d-4e78-afa3-54fbbc0d8bcf req-887bc778-4c6e-4b9e-9293-42a8986a91bd tempest-TestShelveInstance-1848976883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-afec4e98-556d-4e78-afa3-54fbbc0d8bcf req-887bc778-4c6e-4b9e-9293-42a8986a91bd tempest-TestShelveInstance-1848976883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-afec4e98-556d-4e78-afa3-54fbbc0d8bcf req-887bc778-4c6e-4b9e-9293-42a8986a91bd tempest-TestShelveInstance-1848976883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-afec4e98-556d-4e78-afa3-54fbbc0d8bcf req-887bc778-4c6e-4b9e-9293-42a8986a91bd tempest-TestShelveInstance-1848976883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-d2c872c9-e260-47cf-a785-5a5d711b39e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0db0dcd7-567e-48b1-9349-0eb1123b51ca', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:26:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-afec4e98-556d-4e78-afa3-54fbbc0d8bcf req-887bc778-4c6e-4b9e-9293-42a8986a91bd tempest-TestShelveInstance-1848976883 None] attachment_update completed successfully. Jul 27 13:26:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:52 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[89198db0-7bc0-4467-a894-b5621f93cf31]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:26:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:52 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 Jul 27 13:26:52 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:53 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769" returned: 0 in 0.542s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.581s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-34eafad7-d4d3-401c-886f-400c6320f769', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a7a81d4-49e8-4982-844f-1f27f3964a8c', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:26:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-5bf23ac4-27cd-42bd-a1a6-c98b331bde20 req-96c5ca73-b5d0-440c-b43f-88a1bc7f72e3 tempest-TestStampPattern-1013379530 None] attachment_update completed successfully. Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Flow 'volume_create_manager' (b2c0fe31-9d78-4080-9531-8574130ff743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd22bde-a0b3-47b7-9c9d-cc0f6f3bc9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd22bde-a0b3-47b7-9c9d-cc0f6f3bc9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1651286819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894640dc-b48e-4deb-9e02-c413e319163b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a848759103ed409d9f0ba66a7d76e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:57Z,use_quota=True,user_id='2d955d7d04b44b17a598d0a49c6c2239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc80134-e11e-4d30-81f2-ff7308e007a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc80134-e11e-4d30-81f2-ff7308e007a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7789fb4b-8bcf-4548-90b8-daaa68d815d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7789fb4b-8bcf-4548-90b8-daaa68d815d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894640dc-b48e-4deb-9e02-c413e319163b', 'volume_name': 'volume-894640dc-b48e-4deb-9e02-c413e319163b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e04cc61-5085-4681-b87a-184d0a56b617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e04cc61-5085-4681-b87a-184d0a56b617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7fd3f7-4e67-4cce-bdf4-bce0e633ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Volume 894640dc-b48e-4deb-9e02-c413e319163b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894640dc-b48e-4deb-9e02-c413e319163b', 'volume_size': 1} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1651286819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894640dc-b48e-4deb-9e02-c413e319163b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a848759103ed409d9f0ba66a7d76e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:57Z,use_quota=True,user_id='2d955d7d04b44b17a598d0a49c6c2239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Creating volume 894640dc-b48e-4deb-9e02-c413e319163b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:26:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:26:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:57 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b 1073741824 Jul 27 13:26:57 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-258ebddb-605b-4a8c-b07c-29301dedbdcc req-16578341-9045-48b8-b9e1-86c667090875 tempest-TestStampPattern-1013379530 None] Terminate volume connection completed successfully. Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-258ebddb-605b-4a8c-b07c-29301dedbdcc req-16578341-9045-48b8-b9e1-86c667090875 tempest-TestStampPattern-1013379530 None] Deleting attachment 9a7a81d4-49e8-4982-844f-1f27f3964a8c. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Flow 'volume_create_manager' (d2b3a8f6-da94-44b9-a841-a8a3dc48367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1497b2-1985-4dd1-b0e2-78aa07f0f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1497b2-1985-4dd1-b0e2-78aa07f0f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-563082722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54214d55-63eb-4e4b-afba-80c35c48d1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a848759103ed409d9f0ba66a7d76e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:57Z,use_quota=True,user_id='2d955d7d04b44b17a598d0a49c6c2239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9879a7-8196-4673-ba66-f7c65ebcab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9879a7-8196-4673-ba66-f7c65ebcab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb7c053-3c4c-460a-9118-51fa1406b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb7c053-3c4c-460a-9118-51fa1406b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54214d55-63eb-4e4b-afba-80c35c48d1fe', 'volume_name': 'volume-54214d55-63eb-4e4b-afba-80c35c48d1fe', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ebc344-06ff-4274-94e5-cdd3238aaffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ebc344-06ff-4274-94e5-cdd3238aaffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab4f9d7-9ecc-46dd-976f-aa7c799985c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:57 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Volume 54214d55-63eb-4e4b-afba-80c35c48d1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54214d55-63eb-4e4b-afba-80c35c48d1fe', 'volume_size': 1} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:57 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b 1073741824" returned: 0 in 0.898s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:57 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b Jul 27 13:26:57 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:58 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b" returned: 0 in 0.318s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-563082722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54214d55-63eb-4e4b-afba-80c35c48d1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a848759103ed409d9f0ba66a7d76e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:26:57Z,use_quota=True,user_id='2d955d7d04b44b17a598d0a49c6c2239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Creating volume 54214d55-63eb-4e4b-afba-80c35c48d1fe {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:26:58 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:58 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe 1073741824 Jul 27 13:26:58 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7fd3f7-4e67-4cce-bdf4-bce0e633ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894640dc-b48e-4deb-9e02-c413e319163b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e6c7e6-c3e6-4fcb-88f4-3ae483e01b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:58 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Volume volume-894640dc-b48e-4deb-9e02-c413e319163b (894640dc-b48e-4deb-9e02-c413e319163b): created successfully Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e6c7e6-c3e6-4fcb-88f4-3ae483e01b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:58 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Flow 'volume_create_manager' (b2c0fe31-9d78-4080-9531-8574130ff743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2ee85433-8799-47e7-abec-686b5c3335fa tempest-TestServerVolumeAttachmentScenario-7939590 None] Created volume successfully. Jul 27 13:26:59 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe 1073741824" returned: 0 in 0.819s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:26:59 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe Jul 27 13:26:59 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:26:59 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab4f9d7-9ecc-46dd-976f-aa7c799985c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54214d55-63eb-4e4b-afba-80c35c48d1fe', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bed8c7-8692-4c0c-a68c-0fe278e377c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:26:59 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Volume volume-54214d55-63eb-4e4b-afba-80c35c48d1fe (54214d55-63eb-4e4b-afba-80c35c48d1fe): created successfully Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bed8c7-8692-4c0c-a68c-0fe278e377c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:26:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Flow 'volume_create_manager' (d2b3a8f6-da94-44b9-a841-a8a3dc48367f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:26:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-11891e17-7990-4122-a0bf-8fad027a8b4d tempest-TestServerVolumeAttachmentScenario-7939590 None] Created volume successfully. Jul 27 13:27:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-34eafad7-d4d3-401c-886f-400c6320f769-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Lock "cinder-34eafad7-d4d3-401c-886f-400c6320f769-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-quobyte-34eafad7-d4d3-401c-886f-400c6320f769" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-34eafad7-d4d3-401c-886f-400c6320f769" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b826885-a276-4c2f-ba4c-2936200b9a56]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:03 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 Jul 27 13:27:03 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:04 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769" returned: 0 in 0.472s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:04 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769 Jul 27 13:27:04 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:04 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-34eafad7-d4d3-401c-886f-400c6320f769" returned: 0 in 0.349s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-34eafad7-d4d3-401c-886f-400c6320f769" released by "delete_volume" :: held 0.885s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Created reservations ['c97e2771-1d24-4a58-ae70-515bd3bb1f05', '0af72d34-0710-451a-be5b-efd8b831018c', '6aae21d5-e13e-4628-b1b3-a4269f47e666', '5ce1539d-2606-4f16-93ab-a7260b185ddc'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:04 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:04 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-8fa2ed10-b51e-4180-847e-cec4e0941f91-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Lock "cinder-8fa2ed10-b51e-4180-847e-cec4e0941f91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-quobyte-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-quobyte-8fa2ed10-b51e-4180-847e-cec4e0941f91" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-8fa2ed10-b51e-4180-847e-cec4e0941f91" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Deleting offline snapshot 8fa2ed10-b51e-4180-847e-cec4e0941f91 of volume add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] snapshot_file for this snap is: volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dab4b0-3aa5-44c7-929f-cace0d6f91bc]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:05 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.855s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Deleted volume successfully. Jul 27 13:27:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d5ec3f55-f0e6-4bb2-b212-172e0cb45efe tempest-TestStampPattern-1013379530 None] Lock "cinder-34eafad7-d4d3-401c-886f-400c6320f769-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:05 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 Jul 27 13:27:05 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:06 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91" returned: 0 in 0.691s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f2673-1991-45a4-8338-bddef8519e5e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:06 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:27:06 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:06 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.446s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:06 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 Jul 27 13:27:06 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:06 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91" returned: 0 in 0.420s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:06 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91 Jul 27 13:27:06 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:07 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74.8fa2ed10-b51e-4180-847e-cec4e0941f91" returned: 0 in 0.303s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-8fa2ed10-b51e-4180-847e-cec4e0941f91" released by "_delete_snapshot" :: held 2.029s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" released by "delete_snapshot" :: held 2.098s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:07 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Created reservations ['23e21720-c475-45b8-8dab-59c16a685163', '085840d3-2c05-4737-96b6-1216e8e7377e', 'de12e17e-60ab-4ce0-b6d8-e046e3ea2ed0', '94812b87-66fe-4374-9777-4bf1fd035036'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Delete snapshot completed successfully. Jul 27 13:27:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9b3ff5f2-9294-4213-a082-ffadc41613a6 tempest-TestStampPattern-1013379530 None] Lock "cinder-8fa2ed10-b51e-4180-847e-cec4e0941f91-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-add2dd6a-1edf-4d8d-bc54-baf0db7aab74-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Lock "cinder-add2dd6a-1edf-4d8d-bc54-baf0db7aab74-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Acquiring lock "cinder-quobyte-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" acquired by "delete_volume" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:13 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[92deb60f-358b-49a4-b504-0d8f001f5db0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:13 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:27:13 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:14 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.707s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:14 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74 Jul 27 13:27:14 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:14 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Lock "cinder-quobyte-add2dd6a-1edf-4d8d-bc54-baf0db7aab74" released by "delete_volume" :: held 1.204s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Created reservations ['b8754898-0926-43be-8344-6c76ee2761a5', '796dde55-b161-411f-96b4-00749a470571', 'fef05244-7018-4e67-8f10-d15cb84859b9', '0527dc60-da5d-49dd-8e50-b13904d9a855'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:14 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:14 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:15 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.256s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:15 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:15 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Deleted volume successfully. Jul 27 13:27:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-db2eda1d-ac6e-472e-a299-0df796146a89 tempest-TestStampPattern-1013379530 None] Lock "cinder-add2dd6a-1edf-4d8d-bc54-baf0db7aab74-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:24 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=29,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:27:25 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=41,cinder:UPDATE=37,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (5b6c1b1b-95bf-4457-b90e-bdf472ef60db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcfd1e4-a519-4a99-9205-dd27b4701eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcfd1e4-a519-4a99-9205-dd27b4701eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1183580298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc11a5f-513f-44d4-897d-f1437f221d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:28Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcc7145-a2a4-457a-a404-2426f43937de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcc7145-a2a4-457a-a404-2426f43937de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0eb314-9387-45a1-8f11-13ed27f1c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0eb314-9387-45a1-8f11-13ed27f1c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc11a5f-513f-44d4-897d-f1437f221d48', 'volume_name': 'volume-4bc11a5f-513f-44d4-897d-f1437f221d48', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a683ae-2b8c-4fdc-a179-4df8d02a812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a683ae-2b8c-4fdc-a179-4df8d02a812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58047d99-e5ca-4eb2-ac89-a007a27cacd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Volume 4bc11a5f-513f-44d4-897d-f1437f221d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc11a5f-513f-44d4-897d-f1437f221d48', 'volume_size': 1} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1183580298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc11a5f-513f-44d4-897d-f1437f221d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:28Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Creating volume 4bc11a5f-513f-44d4-897d-f1437f221d48 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:28 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:28 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 1073741824 Jul 27 13:27:28 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (8e81a9ea-8231-48f6-99ec-8aba85a34718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc2040-ef92-4789-8ff0-e2226d0776e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc2040-ef92-4789-8ff0-e2226d0776e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1972260209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edef5f7-70d5-4933-850d-306694400a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:28Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352c1ca0-2888-4af9-a223-57939831e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352c1ca0-2888-4af9-a223-57939831e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163e5f87-af2b-478c-a72a-10b37c376e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163e5f87-af2b-478c-a72a-10b37c376e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1edef5f7-70d5-4933-850d-306694400a17', 'volume_name': 'volume-1edef5f7-70d5-4933-850d-306694400a17', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5529a1-dd28-4c7e-b023-c3bbdc5f8894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5529a1-dd28-4c7e-b023-c3bbdc5f8894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630a81e-967f-42c0-874f-10c55563e585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Volume 1edef5f7-70d5-4933-850d-306694400a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1edef5f7-70d5-4933-850d-306694400a17', 'volume_size': 1} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:28 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 1073741824" returned: 0 in 0.487s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:28 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 Jul 27 13:27:28 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (79791a6d-3bb2-4708-b029-30cf4b306c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65f830-7409-4dac-a5ea-451ee95fe62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65f830-7409-4dac-a5ea-451ee95fe62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1203765044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2813f2-ce26-4545-8c3b-77ea337b5aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:29Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe08a262-f3ab-46b7-961d-fa21f5d1800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe08a262-f3ab-46b7-961d-fa21f5d1800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6cc34c-ab85-4180-a7c3-46ac0021819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6cc34c-ab85-4180-a7c3-46ac0021819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2813f2-ce26-4545-8c3b-77ea337b5aaa', 'volume_name': 'volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eefa23-44b3-4268-b2e9-8242e1a299f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eefa23-44b3-4268-b2e9-8242e1a299f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac1f1e7-173e-4647-95cf-fce7133669ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:28 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Volume 4a2813f2-ce26-4545-8c3b-77ea337b5aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa', 'volume_size': 1} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:28 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48" returned: 0 in 0.300s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1972260209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edef5f7-70d5-4933-850d-306694400a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:28Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Creating volume 1edef5f7-70d5-4933-850d-306694400a17 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:28 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58047d99-e5ca-4eb2-ac89-a007a27cacd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc11a5f-513f-44d4-897d-f1437f221d48', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 1073741824 Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c9fbb2-bbff-4d53-b6de-f6c978e57bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Volume volume-4bc11a5f-513f-44d4-897d-f1437f221d48 (4bc11a5f-513f-44d4-897d-f1437f221d48): created successfully Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c9fbb2-bbff-4d53-b6de-f6c978e57bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (5b6c1b1b-95bf-4457-b90e-bdf472ef60db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3cc14986-adb0-4136-8720-d8bc1bc911d8 tempest-CreateVolumesFromImageTest-880146874 None] Created volume successfully. Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (1779fa62-8f66-46da-b839-94d4deb9f3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e105bd1-33d1-4129-9b6c-9894d73b4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e105bd1-33d1-4129-9b6c-9894d73b4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803986417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1418c786-cd93-4eda-8d5b-8c226ede44b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:29Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aba7291-9810-4f56-a1a0-6f9aa8c24e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aba7291-9810-4f56-a1a0-6f9aa8c24e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac537ddc-7cf2-40fa-b3c7-e0ba526fb6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac537ddc-7cf2-40fa-b3c7-e0ba526fb6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1418c786-cd93-4eda-8d5b-8c226ede44b4', 'volume_name': 'volume-1418c786-cd93-4eda-8d5b-8c226ede44b4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a24a91-7ed8-4cd7-9801-85f3f3ea656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a24a91-7ed8-4cd7-9801-85f3f3ea656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9db76b-1186-4301-bbab-94db92e713eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Volume 1418c786-cd93-4eda-8d5b-8c226ede44b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1418c786-cd93-4eda-8d5b-8c226ede44b4', 'volume_size': 1} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:29 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 1073741824" returned: 0 in 0.521s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (928099fe-8636-4ba8-8ecb-e9ef58bd5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bdeff4-3b63-4b81-a2d4-9bc95848fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bdeff4-3b63-4b81-a2d4-9bc95848fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155155920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e6afe5-6428-4606-9d02-7370a7ca8ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:29Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c860d55-8ba6-4f38-a422-9e68430048f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c860d55-8ba6-4f38-a422-9e68430048f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22603098-1da8-4025-a0fe-b1e2c913e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22603098-1da8-4025-a0fe-b1e2c913e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e6afe5-6428-4606-9d02-7370a7ca8ab0', 'volume_name': 'volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898c32e0-485a-454f-a351-d9c81d22b81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898c32e0-485a-454f-a351-d9c81d22b81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b664610-08e6-4192-9be6-55c7ffe36065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Volume 15e6afe5-6428-4606-9d02-7370a7ca8ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0', 'volume_size': 1} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:29 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 Jul 27 13:27:29 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:29 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17" returned: 0 in 0.253s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1203765044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2813f2-ce26-4545-8c3b-77ea337b5aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:29Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Creating volume 4a2813f2-ce26-4545-8c3b-77ea337b5aaa {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630a81e-967f-42c0-874f-10c55563e585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1edef5f7-70d5-4933-850d-306694400a17', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503efa4e-1762-4d72-89cd-bc3ddfe5fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:29 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa 1073741824 Jul 27 13:27:29 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Volume volume-1edef5f7-70d5-4933-850d-306694400a17 (1edef5f7-70d5-4933-850d-306694400a17): created successfully Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503efa4e-1762-4d72-89cd-bc3ddfe5fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (8e81a9ea-8231-48f6-99ec-8aba85a34718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:29 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b70ef374-8492-4914-a15c-708f1377c740 tempest-CreateVolumesFromImageTest-880146874 None] Created volume successfully. Jul 27 13:27:30 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa 1073741824" returned: 0 in 0.450s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:30 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa Jul 27 13:27:30 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:30 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa" returned: 0 in 0.278s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803986417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1418c786-cd93-4eda-8d5b-8c226ede44b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:29Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Creating volume 1418c786-cd93-4eda-8d5b-8c226ede44b4 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:30 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:30 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 1073741824 Jul 27 13:27:30 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac1f1e7-173e-4647-95cf-fce7133669ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a94eaf-eafd-48d1-a98b-ae29fc6ebea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Volume volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa (4a2813f2-ce26-4545-8c3b-77ea337b5aaa): created successfully Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a94eaf-eafd-48d1-a98b-ae29fc6ebea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (79791a6d-3bb2-4708-b029-30cf4b306c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1535ba3b-ca98-4d45-8097-f77aaa9d8cca tempest-CreateVolumesFromImageTest-880146874 None] Created volume successfully. Jul 27 13:27:31 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 1073741824" returned: 0 in 0.517s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:31 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 Jul 27 13:27:31 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:31 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4" returned: 0 in 0.262s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155155920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e6afe5-6428-4606-9d02-7370a7ca8ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f5300ec83d43f0ab741092787ec8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:29Z,use_quota=True,user_id='0460099140e847a48c5386ed22599a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Creating volume 15e6afe5-6428-4606-9d02-7370a7ca8ab0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:31 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:31 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 1073741824 Jul 27 13:27:31 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9db76b-1186-4301-bbab-94db92e713eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1418c786-cd93-4eda-8d5b-8c226ede44b4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832a0c3-26d5-49df-b375-d8dc1d101933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Volume volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 (1418c786-cd93-4eda-8d5b-8c226ede44b4): created successfully Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832a0c3-26d5-49df-b375-d8dc1d101933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (1779fa62-8f66-46da-b839-94d4deb9f3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b7baeed1-aff8-4e7c-a32b-5596d64cfeb9 tempest-CreateVolumesFromImageTest-880146874 None] Created volume successfully. Jul 27 13:27:32 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 1073741824" returned: 0 in 0.527s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:32 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 Jul 27 13:27:32 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:32 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b664610-08e6-4192-9be6-55c7ffe36065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fceeee89-15e4-471d-9d2f-425a87c3e12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Volume volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 (15e6afe5-6428-4606-9d02-7370a7ca8ab0): created successfully Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fceeee89-15e4-471d-9d2f-425a87c3e12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Flow 'volume_create_manager' (928099fe-8636-4ba8-8ecb-e9ef58bd5023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:32 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-81f0c6a8-c8d1-4b00-adae-c2b8794dcca5 tempest-CreateVolumesFromImageTest-880146874 None] Created volume successfully. Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-15e6afe5-6428-4606-9d02-7370a7ca8ab0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-15e6afe5-6428-4606-9d02-7370a7ca8ab0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-quobyte-15e6afe5-6428-4606-9d02-7370a7ca8ab0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-15e6afe5-6428-4606-9d02-7370a7ca8ab0" acquired by "delete_volume" :: waited 0.013s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f116b4d1-a22b-4131-8bda-47caf0d10824]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:33 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:33 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:33 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 Jul 27 13:27:33 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:33 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.254s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:27:33 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:33 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0 Jul 27 13:27:33 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:33 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-15e6afe5-6428-4606-9d02-7370a7ca8ab0" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-15e6afe5-6428-4606-9d02-7370a7ca8ab0" released by "delete_volume" :: held 0.675s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Created reservations ['1bec3eb6-23de-4063-a932-90fac0a2a892', 'd75cd2fc-a72f-4564-82a8-f286e2622e87', '9d5030cc-bc8b-4f9d-9fd8-392798dc573e', '279725c0-5ea3-473f-8b6f-5ff5ca4d1252'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:33 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:33 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:34 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.247s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:34 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Deleted volume successfully. Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eb7734d5-b2ec-4d96-a662-6de73b3f1bb1 tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-15e6afe5-6428-4606-9d02-7370a7ca8ab0-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-1418c786-cd93-4eda-8d5b-8c226ede44b4-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-1418c786-cd93-4eda-8d5b-8c226ede44b4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-quobyte-1418c786-cd93-4eda-8d5b-8c226ede44b4" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-1418c786-cd93-4eda-8d5b-8c226ede44b4" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c11934-e210-4967-9715-fce4237a844c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:34 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 Jul 27 13:27:34 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:34 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:34 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4 Jul 27 13:27:34 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:34 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1418c786-cd93-4eda-8d5b-8c226ede44b4" returned: 0 in 0.277s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:34 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-1418c786-cd93-4eda-8d5b-8c226ede44b4" released by "delete_volume" :: held 0.699s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Created reservations ['28c0989e-785a-4f7b-acf3-8aa49906b0ea', 'afaa5128-00f0-498b-b35a-3990be0bd91a', 'e5ea1c30-8179-42e4-ad1a-1b89e1fde94c', 'ce9a5204-fca9-4a8a-a814-81a3c84f183a'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:35 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:35 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-4a2813f2-ce26-4545-8c3b-77ea337b5aaa-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-4a2813f2-ce26-4545-8c3b-77ea337b5aaa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:35 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Deleted volume successfully. Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-e27356a8-77c5-4d4e-84f2-cb36a796dd73 req-6223b36d-36a4-4036-938f-6e96a25a7c06 tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-e27356a8-77c5-4d4e-84f2-cb36a796dd73 req-6223b36d-36a4-4036-938f-6e96a25a7c06 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-e27356a8-77c5-4d4e-84f2-cb36a796dd73 req-6223b36d-36a4-4036-938f-6e96a25a7c06 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-19ccc7e9-e8d8-4632-90ab-ce3c46aa3eef tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-1418c786-cd93-4eda-8d5b-8c226ede44b4-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-quobyte-4a2813f2-ce26-4545-8c3b-77ea337b5aaa" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-4a2813f2-ce26-4545-8c3b-77ea337b5aaa" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[043eed88-7ebd-4542-b36b-35b1b1724997]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-e27356a8-77c5-4d4e-84f2-cb36a796dd73 req-6223b36d-36a4-4036-938f-6e96a25a7c06 tempest-TestServerVolumeAttachmentScenario-7939590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-894640dc-b48e-4deb-9e02-c413e319163b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6627a926-b8c0-4774-9472-93b8a15f05ab', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:27:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-e27356a8-77c5-4d4e-84f2-cb36a796dd73 req-6223b36d-36a4-4036-938f-6e96a25a7c06 tempest-TestServerVolumeAttachmentScenario-7939590 None] attachment_update completed successfully. Jul 27 13:27:35 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa Jul 27 13:27:35 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:35 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa" returned: 0 in 0.428s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:35 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa Jul 27 13:27:35 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:36 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a2813f2-ce26-4545-8c3b-77ea337b5aaa" returned: 0 in 0.277s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-4a2813f2-ce26-4545-8c3b-77ea337b5aaa" released by "delete_volume" :: held 0.754s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Created reservations ['4ff55069-f159-4ad7-bb32-ca21ef42015f', '41515413-0d7b-430f-9e13-991ab2a5045e', '149af1e1-7d40-4d51-8378-bb2fb5b69ed7', '2235fb89-39b8-41f6-a410-b94ccf0b9ca5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:36 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:36 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-1edef5f7-70d5-4933-850d-306694400a17-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-1edef5f7-70d5-4933-850d-306694400a17-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:36 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:36 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Deleted volume successfully. Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-quobyte-1edef5f7-70d5-4933-850d-306694400a17" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-97b47547-2fce-4282-95ae-5192b44c28df tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-4a2813f2-ce26-4545-8c3b-77ea337b5aaa-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-1edef5f7-70d5-4933-850d-306694400a17" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e718bca3-dfb7-4504-9bfe-8a296b1ebf83]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:36 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 Jul 27 13:27:36 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:37 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17" returned: 0 in 0.357s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:37 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17 Jul 27 13:27:37 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:37 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1edef5f7-70d5-4933-850d-306694400a17" returned: 0 in 0.247s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-1edef5f7-70d5-4933-850d-306694400a17" released by "delete_volume" :: held 0.645s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Created reservations ['e8e35572-58cd-460c-b98d-3cc9a9cb6331', '8bdda35b-61be-4313-9f94-d3a386c1f684', '31f69b7d-e8af-4a55-99de-601473078cdd', '3369ab84-baf2-4c1e-affc-35165cc059f3'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:37 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:37 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-4bc11a5f-513f-44d4-897d-f1437f221d48-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-4bc11a5f-513f-44d4-897d-f1437f221d48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:37 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.307s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Deleted volume successfully. Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "cinder-quobyte-4bc11a5f-513f-44d4-897d-f1437f221d48" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-abd94858-3d80-4984-921b-c86ff12f61ff tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-1edef5f7-70d5-4933-850d-306694400a17-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-4bc11a5f-513f-44d4-897d-f1437f221d48" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[beee6003-72fb-4bea-94b2-7ca33f2d4555]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:37 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 Jul 27 13:27:37 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:38 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48" returned: 0 in 0.409s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:38 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48 Jul 27 13:27:38 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:38 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4bc11a5f-513f-44d4-897d-f1437f221d48" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-quobyte-4bc11a5f-513f-44d4-897d-f1437f221d48" released by "delete_volume" :: held 0.813s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Created reservations ['d6b5756f-b0e5-4a5d-93da-ca5bcb24665a', 'bf20c196-f650-4e7a-9d17-57cc532224a6', 'eebe7d9e-bc06-4395-b693-770756d57007', '84947d62-d299-44a2-bac4-556b01456b0c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:38 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:38 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:39 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.337s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:39 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Deleted volume successfully. Jul 27 13:27:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba6b0c21-63ca-48ab-8362-50a5bee70a4e tempest-CreateVolumesFromImageTest-880146874 None] Lock "cinder-4bc11a5f-513f-44d4-897d-f1437f221d48-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-8c11418f-80f5-4959-a397-ad0807216685 req-05923d3a-7962-4c9a-b69b-e726f079fc52 tempest-TestShelveInstance-1848976883 None] Terminate volume connection completed successfully. Jul 27 13:27:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-8c11418f-80f5-4959-a397-ad0807216685 req-05923d3a-7962-4c9a-b69b-e726f079fc52 tempest-TestShelveInstance-1848976883 None] Deleting attachment 0db0dcd7-567e-48b1-9349-0eb1123b51ca. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:27:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Acquiring lock "cinder-d2c872c9-e260-47cf-a785-5a5d711b39e8-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Lock "cinder-d2c872c9-e260-47cf-a785-5a5d711b39e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Acquiring lock "cinder-quobyte-d2c872c9-e260-47cf-a785-5a5d711b39e8" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Lock "cinder-quobyte-d2c872c9-e260-47cf-a785-5a5d711b39e8" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce51aab-abcf-4037-843b-077420351181]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:41 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 Jul 27 13:27:41 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:41 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8" returned: 0 in 0.519s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:41 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8 Jul 27 13:27:41 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-668b85ba-c6ff-43dc-96d5-66ee3778b570 req-694eef4e-5aa1-4fe9-8fd7-62acd3437c7e tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-668b85ba-c6ff-43dc-96d5-66ee3778b570 req-694eef4e-5aa1-4fe9-8fd7-62acd3437c7e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-668b85ba-c6ff-43dc-96d5-66ee3778b570 req-694eef4e-5aa1-4fe9-8fd7-62acd3437c7e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-668b85ba-c6ff-43dc-96d5-66ee3778b570 req-694eef4e-5aa1-4fe9-8fd7-62acd3437c7e tempest-TestServerVolumeAttachmentScenario-7939590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076', 'name': 'volume-54214d55-63eb-4e4b-afba-80c35c48d1fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f807d648-ce71-423c-a13d-d20049ff7eb6', 'enforce_multipath': True} {{(pid=88202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 27 13:27:41 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d2c872c9-e260-47cf-a785-5a5d711b39e8" returned: 0 in 0.366s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Lock "cinder-quobyte-d2c872c9-e260-47cf-a785-5a5d711b39e8" released by "delete_volume" :: held 0.949s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-668b85ba-c6ff-43dc-96d5-66ee3778b570 req-694eef4e-5aa1-4fe9-8fd7-62acd3437c7e tempest-TestServerVolumeAttachmentScenario-7939590 None] attachment_update completed successfully. Jul 27 13:27:41 devstack cinder-volume[88202]: DEBUG cinder.quota [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Created reservations ['8d8f38da-5bf7-43d1-b4d3-403909cbf8f4', 'f3b1c476-f76f-4d12-984d-ce04288011d0', 'c52e06da-1380-44fd-8cc4-b57349b8003c', '45fe21ef-fbce-4eac-98f4-b2f9235013a4'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:42 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:42 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:42 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.364s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG cinder.manager [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Deleted volume successfully. Jul 27 13:27:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [req-8c11418f-80f5-4959-a397-ad0807216685 req-d70ce382-9668-4253-a0c5-1d19b9705a83 tempest-TestShelveInstance-1848976883 None] Lock "cinder-d2c872c9-e260-47cf-a785-5a5d711b39e8-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-03f253c1-8957-4914-8a07-c896fc24a6f2 req-d5dd79b9-cb02-4a56-806d-dbaa1ad39b7e tempest-TestServerVolumeAttachmentScenario-7939590 None] Terminate volume connection completed successfully. Jul 27 13:27:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-03f253c1-8957-4914-8a07-c896fc24a6f2 req-d5dd79b9-cb02-4a56-806d-dbaa1ad39b7e tempest-TestServerVolumeAttachmentScenario-7939590 None] Deleting attachment f807d648-ce71-423c-a13d-d20049ff7eb6. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:27:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [req-9c76aea2-7133-477d-a476-3a996988160e req-ad6fc8fe-051d-4a3a-a291-8f3b87328876 tempest-TestServerVolumeAttachmentScenario-7939590 None] Terminate volume connection completed successfully. Jul 27 13:27:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [req-9c76aea2-7133-477d-a476-3a996988160e req-ad6fc8fe-051d-4a3a-a291-8f3b87328876 tempest-TestServerVolumeAttachmentScenario-7939590 None] Deleting attachment 6627a926-b8c0-4774-9472-93b8a15f05ab. {{(pid=88202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "cinder-54214d55-63eb-4e4b-afba-80c35c48d1fe-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-54214d55-63eb-4e4b-afba-80c35c48d1fe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "cinder-quobyte-54214d55-63eb-4e4b-afba-80c35c48d1fe" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-quobyte-54214d55-63eb-4e4b-afba-80c35c48d1fe" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea177c8-e868-4be8-bf22-67ec0c6fa56e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:51 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe Jul 27 13:27:51 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:51 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:51 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe Jul 27 13:27:51 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:51 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-54214d55-63eb-4e4b-afba-80c35c48d1fe" returned: 0 in 0.269s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-quobyte-54214d55-63eb-4e4b-afba-80c35c48d1fe" released by "delete_volume" :: held 0.682s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:51 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Created reservations ['8b5445d3-1b9d-4cd4-9274-e62addd2e5d0', 'a29662fc-b7e7-40bd-8de0-6a2871873150', '36fd4801-f0ce-4eb1-8e43-49511ee1fb45', '8dbede91-522b-4b89-9cc0-1f05b4f972db'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:52 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:52 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "cinder-894640dc-b48e-4deb-9e02-c413e319163b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:52 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.272s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Deleted volume successfully. Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-894640dc-b48e-4deb-9e02-c413e319163b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-727e41c3-3b0d-4b78-9a4d-628f41f8e40e tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-54214d55-63eb-4e4b-afba-80c35c48d1fe-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "cinder-quobyte-894640dc-b48e-4deb-9e02-c413e319163b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-quobyte-894640dc-b48e-4deb-9e02-c413e319163b" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8c657-5bc7-489c-a24b-4342f77e48de]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:52 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b Jul 27 13:27:52 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:52 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b" returned: 0 in 0.392s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:52 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b Jul 27 13:27:52 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:53 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-894640dc-b48e-4deb-9e02-c413e319163b" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-quobyte-894640dc-b48e-4deb-9e02-c413e319163b" released by "delete_volume" :: held 0.699s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Created reservations ['d7f49416-3c2e-404d-856f-b3db9f77fc75', '67d90f3a-14d8-4adc-9c56-5c0721f6ae05', '27e0ed67-2c0a-4204-9b29-0b1070530bcc', 'd9d0b855-9485-4548-b43e-8439a6868b4d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:53 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:27:53 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:53 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.289s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:27:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Deleted volume successfully. Jul 27 13:27:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c6e8869b-975e-4cbe-a166-8ab6059beb50 tempest-TestServerVolumeAttachmentScenario-7939590 None] Lock "cinder-894640dc-b48e-4deb-9e02-c413e319163b-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (5f78e4ec-4164-47c2-acd3-e0d949cbe8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b1d47-b74b-44a8-817e-22438acaed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b1d47-b74b-44a8-817e-22438acaed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098992907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0565e24b-c747-4d70-b59f-5d36fa73b234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:54Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f39ba5-39a3-4306-9556-a64cc21e1b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f39ba5-39a3-4306-9556-a64cc21e1b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e00463c-2015-4b97-912a-0180eab659f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e00463c-2015-4b97-912a-0180eab659f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0565e24b-c747-4d70-b59f-5d36fa73b234', 'volume_name': 'volume-0565e24b-c747-4d70-b59f-5d36fa73b234', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d16eb-beb9-483c-8f8a-ad657ec67062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d16eb-beb9-483c-8f8a-ad657ec67062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01704aa2-9dd3-4702-adcf-9926a01b0d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume 0565e24b-c747-4d70-b59f-5d36fa73b234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0565e24b-c747-4d70-b59f-5d36fa73b234', 'volume_size': 1} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098992907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0565e24b-c747-4d70-b59f-5d36fa73b234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:54Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating volume 0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:54 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:54 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 1073741824 Jul 27 13:27:54 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:55 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 1073741824" returned: 0 in 0.447s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:55 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 Jul 27 13:27:55 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:55 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01704aa2-9dd3-4702-adcf-9926a01b0d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0565e24b-c747-4d70-b59f-5d36fa73b234', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2aa27a-b9cd-429f-969f-b62963994e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume volume-0565e24b-c747-4d70-b59f-5d36fa73b234 (0565e24b-c747-4d70-b59f-5d36fa73b234): created successfully Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2aa27a-b9cd-429f-969f-b62963994e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (5f78e4ec-4164-47c2-acd3-e0d949cbe8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-16caa29f-ade7-43cd-8155-b0b00613f704 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created volume successfully. Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating offline snapshot ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 of volume 0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d152bce-f838-4302-bff3-818d6e2c574f]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:27:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:55 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 Jul 27 13:27:55 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:56 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234" returned: 0 in 0.397s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:56 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 1G Jul 27 13:27:56 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:56 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 1G" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0565e24b-c747-4d70-b59f-5d36fa73b234 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:56 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0565e24b-c747-4d70-b59f-5d36fa73b234 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 Jul 27 13:27:56 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:56 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0565e24b-c747-4d70-b59f-5d36fa73b234 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:56 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 is being set with open permissions: ugo+rw Jul 27 13:27:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:56 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 Jul 27 13:27:56 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:57 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:57 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info Jul 27 13:27:57 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:57 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info" returned: 0 in 0.253s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:57 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info is being set with open permissions: ugo+rw Jul 27 13:27:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:57 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info Jul 27 13:27:57 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:57 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 27 13:27:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.info" returned: 0 in 0.294s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:27:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5d7243fb-677e-4304-b0c8-5542113f4846 tempest-CreateVolumesFromSnapshotTest-692893809 None] Create snapshot completed successfully Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (9e39bac5-84c5-45f5-b23e-2563edf291a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b05d33a-f660-47f7-af96-96d259aa799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b05d33a-f660-47f7-af96-96d259aa799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321411649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38654c9b-8f04-4f04-9121-af4aa8423a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:59Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfef630a-a682-4e48-9da6-17cad8e79551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfef630a-a682-4e48-9da6-17cad8e79551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3110902f-1df6-4f74-b96a-127d3589bc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3110902f-1df6-4f74-b96a-127d3589bc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38654c9b-8f04-4f04-9121-af4aa8423a77', 'volume_name': 'volume-38654c9b-8f04-4f04-9121-af4aa8423a77', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c3264d-904f-4e1d-bc71-fc89ffad267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c3264d-904f-4e1d-bc71-fc89ffad267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573f9b3f-8072-447a-8e61-9fffaf399cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:59 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume 38654c9b-8f04-4f04-9121-af4aa8423a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38654c9b-8f04-4f04-9121-af4aa8423a77', 'volume_size': 1} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321411649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38654c9b-8f04-4f04-9121-af4aa8423a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:27:59Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating volume 38654c9b-8f04-4f04-9121-af4aa8423a77 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:27:59 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:27:59 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 1073741824 Jul 27 13:27:59 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (cb7360fd-e643-4b34-a4ca-80a1f515a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c111731a-5ce4-4ad7-a0c6-7d542c650f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:27:59 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c111731a-5ce4-4ad7-a0c6-7d542c650f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1819455763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d397c24-9bda-4696-b5a1-65ddd58f3642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:00Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7accb48f-cd55-462d-96f2-49a86544173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7accb48f-cd55-462d-96f2-49a86544173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb912c9-3fcb-4483-a86c-b9dbeaac9933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb912c9-3fcb-4483-a86c-b9dbeaac9933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d397c24-9bda-4696-b5a1-65ddd58f3642', 'volume_name': 'volume-8d397c24-9bda-4696-b5a1-65ddd58f3642', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f698e9-c817-4628-8afa-b65562d5898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f698e9-c817-4628-8afa-b65562d5898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6302ba-2ccb-4dd0-8dfe-c44bf5b9a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume 8d397c24-9bda-4696-b5a1-65ddd58f3642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d397c24-9bda-4696-b5a1-65ddd58f3642', 'volume_size': 1} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:00 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 1073741824" returned: 0 in 0.664s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:00 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 Jul 27 13:28:00 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (2f0a6680-5a28-4b8c-a5e2-a317b88ebf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7499283f-32af-404c-938d-9b16f18ab5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7499283f-32af-404c-938d-9b16f18ab5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829051413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:00Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6e622-b9b1-4ce6-80dc-23943e9efbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6e622-b9b1-4ce6-80dc-23943e9efbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c35d5b2-2264-4df9-be0e-feba31a66c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c35d5b2-2264-4df9-be0e-feba31a66c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c', 'volume_name': 'volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a83cd1e-2d09-4ebe-95f6-199ec1d3af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a83cd1e-2d09-4ebe-95f6-199ec1d3af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30358867-9bca-437b-9593-262a8b52070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c', 'volume_size': 1} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:00 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77" returned: 0 in 0.327s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1819455763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d397c24-9bda-4696-b5a1-65ddd58f3642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:00Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating volume 8d397c24-9bda-4696-b5a1-65ddd58f3642 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:00 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:00 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 1073741824 Jul 27 13:28:00 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573f9b3f-8072-447a-8e61-9fffaf399cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38654c9b-8f04-4f04-9121-af4aa8423a77', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30196633-33c3-43e6-8212-e2d8ae5de598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume volume-38654c9b-8f04-4f04-9121-af4aa8423a77 (38654c9b-8f04-4f04-9121-af4aa8423a77): created successfully Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30196633-33c3-43e6-8212-e2d8ae5de598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (9e39bac5-84c5-45f5-b23e-2563edf291a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:00 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2c1c16fd-f06f-4724-bc3c-af7a05b2067c tempest-CreateVolumesFromSnapshotTest-692893809 None] Created volume successfully. Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (4ec80ca6-e8ef-4864-8420-86560365679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce62243-fb81-48cb-913e-274a7290a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce62243-fb81-48cb-913e-274a7290a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909509720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b942d726-be5b-4149-b587-2749232d7d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:01Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b246f5-37aa-4dd8-8218-0983eb51b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b246f5-37aa-4dd8-8218-0983eb51b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b167e2-1cb5-4e6e-86de-fbab48f26691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b167e2-1cb5-4e6e-86de-fbab48f26691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b942d726-be5b-4149-b587-2749232d7d7e', 'volume_name': 'volume-b942d726-be5b-4149-b587-2749232d7d7e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34003ede-7455-4aab-9d59-76e6d7133b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34003ede-7455-4aab-9d59-76e6d7133b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4eb272f-5a30-4397-9700-0794796c96a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:00 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume b942d726-be5b-4149-b587-2749232d7d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b942d726-be5b-4149-b587-2749232d7d7e', 'volume_size': 1} Jul 27 13:28:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:01 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 1073741824" returned: 0 in 0.652s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (e28b70bb-e97a-4c40-868f-6b82e93a210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408e77df-b2cf-4ee7-8f51-ebc4f99456f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408e77df-b2cf-4ee7-8f51-ebc4f99456f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273971483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019efd57-31b6-4c57-98a2-6d6d4e2dff2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:01Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52720efb-6b87-4ead-b508-d6162833e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52720efb-6b87-4ead-b508-d6162833e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239c10f5-610c-49a8-9c18-f125c0e4c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239c10f5-610c-49a8-9c18-f125c0e4c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019efd57-31b6-4c57-98a2-6d6d4e2dff2c', 'volume_name': 'volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b200b2-d1a3-4b3e-9fb1-777e2b112414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b200b2-d1a3-4b3e-9fb1-777e2b112414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c82a90-0ce3-45ae-a5fe-1fbacbcd2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:01 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume 019efd57-31b6-4c57-98a2-6d6d4e2dff2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c', 'volume_size': 1} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:01 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 Jul 27 13:28:01 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:01 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642" returned: 0 in 0.246s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829051413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:00Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating volume dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:01 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:01 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c 1073741824 Jul 27 13:28:01 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6302ba-2ccb-4dd0-8dfe-c44bf5b9a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d397c24-9bda-4696-b5a1-65ddd58f3642', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4827eb4-c957-40af-8583-8061709d802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:01 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 (8d397c24-9bda-4696-b5a1-65ddd58f3642): created successfully Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4827eb4-c957-40af-8583-8061709d802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:01 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (cb7360fd-e643-4b34-a4ca-80a1f515a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-70c74768-b753-4581-9732-97d90d4e4933 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created volume successfully. Jul 27 13:28:02 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c 1073741824" returned: 0 in 0.470s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:02 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c Jul 27 13:28:02 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:02 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909509720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b942d726-be5b-4149-b587-2749232d7d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:01Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating volume b942d726-be5b-4149-b587-2749232d7d7e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:02 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30358867-9bca-437b-9593-262a8b52070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92016e35-5bb9-47c8-99b8-0fd543bbc1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:02 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e 1073741824 Jul 27 13:28:02 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:02 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c (dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c): created successfully Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92016e35-5bb9-47c8-99b8-0fd543bbc1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (2f0a6680-5a28-4b8c-a5e2-a317b88ebf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:02 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-046a5ced-6c14-4c8e-99fd-d2fe629ea64e tempest-CreateVolumesFromSnapshotTest-692893809 None] Created volume successfully. Jul 27 13:28:02 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e 1073741824" returned: 0 in 0.483s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:02 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e Jul 27 13:28:02 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:03 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273971483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019efd57-31b6-4c57-98a2-6d6d4e2dff2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793cb9ee30845b3a5b1566a9001106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:01Z,use_quota=True,user_id='4066cdcc6f1b4f1fb6804c431eadf8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Creating volume 019efd57-31b6-4c57-98a2-6d6d4e2dff2c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:03 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4eb272f-5a30-4397-9700-0794796c96a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b942d726-be5b-4149-b587-2749232d7d7e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:03 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c 1073741824 Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471a0261-5386-4948-8007-b93e5fcb24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:03 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume volume-b942d726-be5b-4149-b587-2749232d7d7e (b942d726-be5b-4149-b587-2749232d7d7e): created successfully Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471a0261-5386-4948-8007-b93e5fcb24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (4ec80ca6-e8ef-4864-8420-86560365679f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ff80cf9f-e700-4e4e-87f5-29ac6616857a tempest-CreateVolumesFromSnapshotTest-692893809 None] Created volume successfully. Jul 27 13:28:03 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c 1073741824" returned: 0 in 0.492s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:03 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c Jul 27 13:28:03 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:03 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c" returned: 0 in 0.276s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c82a90-0ce3-45ae-a5fe-1fbacbcd2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28eed66a-805f-4e3b-90ef-c538aba29edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Volume volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c (019efd57-31b6-4c57-98a2-6d6d4e2dff2c): created successfully Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28eed66a-805f-4e3b-90ef-c538aba29edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Flow 'volume_create_manager' (e28b70bb-e97a-4c40-868f-6b82e93a210e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ae4857b9-0a59-49cd-bbcf-29cd1a48beb5 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created volume successfully. Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-019efd57-31b6-4c57-98a2-6d6d4e2dff2c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-019efd57-31b6-4c57-98a2-6d6d4e2dff2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-019efd57-31b6-4c57-98a2-6d6d4e2dff2c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-019efd57-31b6-4c57-98a2-6d6d4e2dff2c" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b3e39-6856-498d-b365-e6e4dd40ce80]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:04 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c Jul 27 13:28:04 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:05 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c" returned: 0 in 0.398s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:05 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c Jul 27 13:28:05 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:05 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-019efd57-31b6-4c57-98a2-6d6d4e2dff2c" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-019efd57-31b6-4c57-98a2-6d6d4e2dff2c" released by "delete_volume" :: held 0.700s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['40f1214b-37d0-455d-a2c4-3f603de76826', '163cbef6-dcfa-4e17-8e08-1adbe6e27376', '53cf3e92-fa5c-45be-98b8-67552e882712', '76542d09-a776-4bb2-933a-c31e5ce0a894'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:05 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:05 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:05 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-b942d726-be5b-4149-b587-2749232d7d7e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-b942d726-be5b-4149-b587-2749232d7d7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleted volume successfully. Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-57684c7b-4d4c-41e9-aa1c-411813f04b65 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-019efd57-31b6-4c57-98a2-6d6d4e2dff2c-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-b942d726-be5b-4149-b587-2749232d7d7e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-b942d726-be5b-4149-b587-2749232d7d7e" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6be03-7475-403a-a0b6-c502fd61f6c5]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:06 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e Jul 27 13:28:06 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:06 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e" returned: 0 in 0.392s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:06 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e Jul 27 13:28:06 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:06 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b942d726-be5b-4149-b587-2749232d7d7e" returned: 0 in 0.245s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-b942d726-be5b-4149-b587-2749232d7d7e" released by "delete_volume" :: held 0.683s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['eb87932c-532a-41ab-9eb7-c67bc9eace78', 'a3d92237-e3c7-43bb-aa8b-2cef98aaecfb', '7daf859e-334b-4ea2-b698-4f8b29ba6974', 'd1ac0c23-84a3-42e7-b26e-cab3a94ef2d8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:06 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:06 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:07 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleted volume successfully. Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-790301ac-5eb3-4617-aabe-edfdcfae9823 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-b942d726-be5b-4149-b587-2749232d7d7e-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ccc5dd-5d6e-40cd-84c9-22091d883fcb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:07 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c Jul 27 13:28:07 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:07 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c" returned: 0 in 0.361s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:07 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c Jul 27 13:28:07 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:07 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c" released by "delete_volume" :: held 0.667s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['ef46cf64-9a9f-4a25-8658-7c960513f6ac', 'a7105c2d-5c5e-40ac-99e3-a90431a7d3d3', '06866409-f17b-4b74-ab71-3bdaf07b73d7', 'b5b465f0-d593-4908-9ed4-0bda02c4cf21'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:08 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:08 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-8d397c24-9bda-4696-b5a1-65ddd58f3642-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-8d397c24-9bda-4696-b5a1-65ddd58f3642-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:08 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.367s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleted volume successfully. Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-8d397c24-9bda-4696-b5a1-65ddd58f3642" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9e9d44a2-a06c-4a15-8b40-48a21209e0f6 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-dc0c20e1-81f8-4c83-a7b8-b2a07d5b287c-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-8d397c24-9bda-4696-b5a1-65ddd58f3642" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1777373e-323d-43b0-85d5-22c7fb2e245c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:08 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 Jul 27 13:28:08 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:08 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642" returned: 0 in 0.411s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:08 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642 Jul 27 13:28:08 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:09 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d397c24-9bda-4696-b5a1-65ddd58f3642" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-8d397c24-9bda-4696-b5a1-65ddd58f3642" released by "delete_volume" :: held 0.715s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['34858cf6-87bc-4815-bd34-d4d8465999a7', '38691a2c-420d-4311-86eb-410250217a64', '127f9b5d-6820-4c35-9eaa-adc5b09ed435', '6d56fa45-ddbf-43e5-998f-1ffd029a16f1'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:09 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:09 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-38654c9b-8f04-4f04-9121-af4aa8423a77-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-38654c9b-8f04-4f04-9121-af4aa8423a77-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:09 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.363s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleted volume successfully. Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-38654c9b-8f04-4f04-9121-af4aa8423a77" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-38654c9b-8f04-4f04-9121-af4aa8423a77" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4164e478-7119-46a7-8514-f0b129dd4296 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-8d397c24-9bda-4696-b5a1-65ddd58f3642-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4a0d5-ea45-4dd2-a31a-b636bd6a6538]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:09 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 Jul 27 13:28:09 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:10 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:10 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77 Jul 27 13:28:10 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:10 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-38654c9b-8f04-4f04-9121-af4aa8423a77" returned: 0 in 0.273s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-38654c9b-8f04-4f04-9121-af4aa8423a77" released by "delete_volume" :: held 0.742s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['66e669ca-7f0c-4055-ab9b-bf31bca807d5', '386fb7b2-5015-41c4-9b83-cd4462ffa2ee', '3b2a9e36-47f0-4fc6-a545-54d4a9872fba', '4a323955-0dd5-43e4-87ab-35e2ac027a62'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:10 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:10 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-0565e24b-c747-4d70-b59f-5d36fa73b234" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-0565e24b-c747-4d70-b59f-5d36fa73b234" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:10 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleting offline snapshot ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 of volume 0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] snapshot_file for this snap is: volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.323s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleted volume successfully. Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d394ab-c5ed-411d-a6ca-9e0be161356c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:10 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1bc13ff2-1483-4357-90ab-6f5651f08a07 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-38654c9b-8f04-4f04-9121-af4aa8423a77-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:10 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 Jul 27 13:28:10 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:11 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0565e24b-c747-4d70-b59f-5d36fa73b234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:28:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3beca3c-8fb4-438c-8659-ba1d66b241fb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:11 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 Jul 27 13:28:11 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:11 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:11 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 Jul 27 13:28:11 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:12 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" returned: 0 in 0.391s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:12 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0 Jul 27 13:28:12 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:12 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234.ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0" released by "_delete_snapshot" :: held 1.569s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-0565e24b-c747-4d70-b59f-5d36fa73b234" released by "delete_snapshot" :: held 1.607s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['6098ebb1-e462-4251-9329-510e4a2e3151', '7c088d6a-704d-4a44-8aea-bb007b331317', '3b8ee887-7edb-499b-92fc-2033376c779d', '688e6822-013c-4a19-a31d-ada5304d646c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Delete snapshot completed successfully. Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-22f7caa0-c6a2-442b-abea-c7a3a7219160 tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-ca86bef3-2c94-4c61-9dd8-0eaf46ec59f0-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-0565e24b-c747-4d70-b59f-5d36fa73b234-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-0565e24b-c747-4d70-b59f-5d36fa73b234-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "cinder-quobyte-0565e24b-c747-4d70-b59f-5d36fa73b234" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-0565e24b-c747-4d70-b59f-5d36fa73b234" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f81b68c-2356-48cc-926f-135f7f567b5d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:13 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 Jul 27 13:28:13 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:13 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234" returned: 0 in 0.411s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:13 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234 Jul 27 13:28:13 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:13 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-0565e24b-c747-4d70-b59f-5d36fa73b234" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-quobyte-0565e24b-c747-4d70-b59f-5d36fa73b234" released by "delete_volume" :: held 0.749s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Created reservations ['6ef3f3ba-22f3-4c27-8dd3-b3e6175f2f33', '4eaf32b4-c111-4b5f-9c60-90e0a1a50834', 'b1ab396d-a204-417e-885b-c6e3654fc198', 'eae44ece-d64b-4aec-a7a3-33e9f928efdb'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:13 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:13 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:14 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:14 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Deleted volume successfully. Jul 27 13:28:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8892bb69-7a84-4005-a27e-161dadf3d89b tempest-CreateVolumesFromSnapshotTest-692893809 None] Lock "cinder-0565e24b-c747-4d70-b59f-5d36fa73b234-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Flow 'volume_create_manager' (99aca0b5-53de-43b2-a9d3-92f8ad3a74f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecc1964-fde3-436a-b806-db238977650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecc1964-fde3-436a-b806-db238977650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4939e159445544ddbde482fa8ffee847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:20Z,use_quota=True,user_id='fe179d8d87874aa3afc2124582817ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a782a1-d72b-42f3-b82b-9c1eee6255d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a782a1-d72b-42f3-b82b-9c1eee6255d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f149002c-aded-4630-82a5-ce0aab5f18b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f149002c-aded-4630-82a5-ce0aab5f18b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8cc8b2f-8f7c-44d8-84c6-02f8160f6c57', 'volume_name': 'volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57', 'volume_size': 1, 'image_id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b1a056c-3115-4658-9b24-e23a6277f504', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b4218ddcb7ce5b373a669da9baff131d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4939e159445544ddbde482fa8ffee847', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d75bba8fadd1496bf39b845f4101bb69c78b50e8dfa528b608769e5a46830f7f224163a65279ba1aa4dd178762fce5c2510bc016afb054d6df1eaf2a4f73cd2', 'id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'created_at': datetime.datetime(2026, 7, 27, 11, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b1a056c-3115-4658-9b24-e23a6277f504/file', 'properties': {}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c23b82a-0f43-4b21-9768-0fe38f8a3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c23b82a-0f43-4b21-9768-0fe38f8a3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96187b11-5947-402f-aa1a-8c341d04c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:19 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Volume d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57', 'volume_size': 1, 'image_id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b1a056c-3115-4658-9b24-e23a6277f504', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b4218ddcb7ce5b373a669da9baff131d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4939e159445544ddbde482fa8ffee847', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d75bba8fadd1496bf39b845f4101bb69c78b50e8dfa528b608769e5a46830f7f224163a65279ba1aa4dd178762fce5c2510bc016afb054d6df1eaf2a4f73cd2', 'id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'created_at': datetime.datetime(2026, 7, 27, 11, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b1a056c-3115-4658-9b24-e23a6277f504/file', 'properties': {}}, 'image_service': } Jul 27 13:28:19 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Trying to clone d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 from image 5b1a056c-3115-4658-9b24-e23a6277f504 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5b1a056c-3115-4658-9b24-e23a6277f504', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:28:20 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Image download 0.00 MB at 0.00 MB/s Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6514a6-bee7-4c76-8c8f-e25b0f99a875]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:20 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD Jul 27 13:28:20 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:20 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:20 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD Jul 27 13:28:20 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:20 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Temporary image 5b1a056c-3115-4658-9b24-e23a6277f504 is fetched for user fe179d8d87874aa3afc2124582817ab4. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e76f375-c5ec-432b-87c8-20c8fe9a3c53]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:21 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD Jul 27 13:28:21 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:21 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:21 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD Jul 27 13:28:21 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:21 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4939e159445544ddbde482fa8ffee847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:20Z,use_quota=True,user_id='fe179d8d87874aa3afc2124582817ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Creating volume d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:21 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:21 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 1073741824 Jul 27 13:28:21 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:22 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 1073741824" returned: 0 in 0.479s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:22 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 Jul 27 13:28:22 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:22 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Attempting download of 5b1a056c-3115-4658-9b24-e23a6277f504 ((None, [{'url': 'file:///opt/stack/data/glance/images/5b1a056c-3115-4658-9b24-e23a6277f504', 'metadata': {}}])) to volume d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eebc790-31e7-448f-b904-2012714ded4d]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:22 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op Jul 27 13:28:22 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:23 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op" returned: 0 in 0.381s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:23 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op Jul 27 13:28:23 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:23 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op" returned: 1 in 0.345s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b1a056c-3115-4658-9b24-e23a6277f504_lhg_e2op' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[87341c9e-8cf6-46c2-8239-5c7af0ce6fb4]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Flow 'volume_create_manager' (d2ca94bb-5816-4ca8-a0d3-690a88eace39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75870b8-9aa6-49f1-8005-f2cef1af12f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75870b8-9aa6-49f1-8005-f2cef1af12f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-651960853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee020da0-8d8b-4df6-9b7f-613ca1aeff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ce4823e43240d0b2915893dbb2811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:23Z,use_quota=True,user_id='9b06ea9200c345929695c966a3ad4000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe5e554-b5db-4667-abd7-27597f35574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe5e554-b5db-4667-abd7-27597f35574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0e2ae9-daf7-4868-807a-e969d66bf2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0e2ae9-daf7-4868-807a-e969d66bf2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee020da0-8d8b-4df6-9b7f-613ca1aeff6d', 'volume_name': 'volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da2bafb-51f1-4466-bdcc-4cadfc473720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da2bafb-51f1-4466-bdcc-4cadfc473720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:23 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b3a615-8c38-4e56-9bcb-9627a1f579c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:23 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:23 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Volume ee020da0-8d8b-4df6-9b7f-613ca1aeff6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d', 'volume_size': 1} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-651960853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee020da0-8d8b-4df6-9b7f-613ca1aeff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ce4823e43240d0b2915893dbb2811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:23Z,use_quota=True,user_id='9b06ea9200c345929695c966a3ad4000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Creating volume ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:23 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:23 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d 1073741824 Jul 27 13:28:23 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:23 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:23 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD Jul 27 13:28:23 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:23 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d 1073741824" returned: 0 in 0.457s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:24 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d Jul 27 13:28:24 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:24 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] 5b1a056c-3115-4658-9b24-e23a6277f504 was raw, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:24 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 Jul 27 13:28:24 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:24 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" returned: 0 in 0.254s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b3a615-8c38-4e56-9bcb-9627a1f579c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932ed35f-f6b2-4e91-b723-22feca6f43ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Volume volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d (ee020da0-8d8b-4df6-9b7f-613ca1aeff6d): created successfully Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932ed35f-f6b2-4e91-b723-22feca6f43ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Flow 'volume_create_manager' (d2ca94bb-5816-4ca8-a0d3-690a88eace39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-564b48fd-fc22-4ac4-9a2a-2f97d2b08359 tempest-TestImageHashVerification-1403402539 None] Created volume successfully. Jul 27 13:28:24 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" returned: 0 in 0.452s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5b1a056c-3115-4658-9b24-e23a6277f504_57g12asydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:28:24 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Converted 0.00 MB image at 0.00 MB/s Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:24 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 1G Jul 27 13:28:24 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:24 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 1G" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Downloaded image 5b1a056c-3115-4658-9b24-e23a6277f504 ((None, [{'url': 'file:///opt/stack/data/glance/images/5b1a056c-3115-4658-9b24-e23a6277f504', 'metadata': {}}])) to volume d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Temporary image 5b1a056c-3115-4658-9b24-e23a6277f504 for user fe179d8d87874aa3afc2124582817ab4 is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Marking volume d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=118,cinder:UPDATE=164,cinder:DELETE=14,cinder:INSERT=35 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Copying metadata from image 5b1a056c-3115-4658-9b24-e23a6277f504 to d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Creating volume glance metadata for volume d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 backed by image 5b1a056c-3115-4658-9b24-e23a6277f504 with: {'image_id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b4218ddcb7ce5b373a669da9baff131d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96187b11-5947-402f-aa1a-8c341d04c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57', 'volume_size': 1, 'image_id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b1a056c-3115-4658-9b24-e23a6277f504', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b4218ddcb7ce5b373a669da9baff131d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4939e159445544ddbde482fa8ffee847', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d75bba8fadd1496bf39b845f4101bb69c78b50e8dfa528b608769e5a46830f7f224163a65279ba1aa4dd178762fce5c2510bc016afb054d6df1eaf2a4f73cd2', 'id': '5b1a056c-3115-4658-9b24-e23a6277f504', 'created_at': datetime.datetime(2026, 7, 27, 11, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b1a056c-3115-4658-9b24-e23a6277f504/file', 'properties': {}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da12ebc9-47c6-428f-a712-b1bbbc085d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Volume volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 (d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57): created successfully Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da12ebc9-47c6-428f-a712-b1bbbc085d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Flow 'volume_create_manager' (99aca0b5-53de-43b2-a9d3-92f8ad3a74f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-544f6cb4-2466-44cb-80fa-4435ede4482a tempest-VolumeImageDependencyTests-1494705539 None] Created volume successfully. Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=160,cinder:SELECT=133,cinder:INSERT=45,cinder:DELETE=14 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b12eb-9a7e-4e07-9f94-4c4df6df377b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:25 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d Jul 27 13:28:25 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:25 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" returned: 0 in 0.345s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7025254-fe22-4fde-9b71-e42e7cd13723]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:25 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d Jul 27 13:28:25 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:25 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" returned: 0 in 0.359s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d /opt/stack/data/cinder/conversion/ee020da0-8d8b-4df6-9b7f-613ca1aeff6d.temp_image.f3ece668-de2f-444c-af5c-033a902170a1k6aqvldt.img {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:25 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d /opt/stack/data/cinder/conversion/ee020da0-8d8b-4df6-9b7f-613ca1aeff6d.temp_image.f3ece668-de2f-444c-af5c-033a902170a1k6aqvldt.img Jul 27 13:28:25 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Acquiring lock "cinder-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Lock "cinder-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Acquiring lock "cinder-quobyte-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Lock "cinder-quobyte-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9743b57a-74b6-4caa-b989-88ca7e6b78bf]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:26 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 Jul 27 13:28:26 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:26 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:26 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57 Jul 27 13:28:26 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:27 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" returned: 0 in 0.438s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Lock "cinder-quobyte-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57" released by "delete_volume" :: held 1.092s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Created reservations ['29387c33-343d-4b3c-9b3c-b7d638aba28b', '92ef73be-1196-48ec-b79f-db87138e555c', '59339b3f-917d-4da3-a053-bd58f2422a05', 'f368827b-cfaf-462e-9b77-18fea1d4d33b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:27 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:27 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:28 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.623s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:28 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Deleted volume successfully. Jul 27 13:28:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f3572e60-d4b3-4959-a9bb-64a795558316 tempest-VolumeImageDependencyTests-1494705539 None] Lock "cinder-d8cc8b2f-8f7c-44d8-84c6-02f8160f6c57-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:30 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d /opt/stack/data/cinder/conversion/ee020da0-8d8b-4df6-9b7f-613ca1aeff6d.temp_image.f3ece668-de2f-444c-af5c-033a902170a1k6aqvldt.img" returned: 0 in 4.673s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2ebdbe-2646-4821-8ab5-79beeb0e0d37]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:30 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d Jul 27 13:28:30 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:31 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" returned: 0 in 0.613s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:31 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/conversion/ee020da0-8d8b-4df6-9b7f-613ca1aeff6d.temp_image.f3ece668-de2f-444c-af5c-033a902170a1k6aqvldt.img {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:28:31 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Converted 1024.00 MB image at 219.09 MB/s Jul 27 13:28:31 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] f3ece668-de2f-444c-af5c-033a902170a1 was raw, no need to convert to raw {{(pid=88202) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Flow 'volume_create_manager' (583d570c-e6fa-4bf1-b1db-1fef63a26cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea977615-087f-41d9-8051-22296b10ca58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea977615-087f-41d9-8051-22296b10ca58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486f2c1f-76e7-463d-86be-dd81c67bfda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c908e3e46c4327a6a71dbb2524a6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:33Z,use_quota=True,user_id='e8f90c9a2ff24e25818010a052b8d7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690ed7e5-e617-4369-9c81-45df67a478a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690ed7e5-e617-4369-9c81-45df67a478a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894cb085-6b9f-46ec-bdf6-6cd71cb0e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894cb085-6b9f-46ec-bdf6-6cd71cb0e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486f2c1f-76e7-463d-86be-dd81c67bfda4', 'volume_name': 'volume-486f2c1f-76e7-463d-86be-dd81c67bfda4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606240de-ef1a-4613-ba7b-7c42d1b882ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606240de-ef1a-4613-ba7b-7c42d1b882ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e71ade-ea5e-4659-8d99-a0139292bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Volume 486f2c1f-76e7-463d-86be-dd81c67bfda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486f2c1f-76e7-463d-86be-dd81c67bfda4', 'volume_size': 1} Jul 27 13:28:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:33 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:33 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:33 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:28:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:28:42 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:28:42 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.400s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Uploaded volume to glance image-id: f3ece668-de2f-444c-af5c-033a902170a1. {{(pid=88202) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.862s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486f2c1f-76e7-463d-86be-dd81c67bfda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c908e3e46c4327a6a71dbb2524a6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:33Z,use_quota=True,user_id='e8f90c9a2ff24e25818010a052b8d7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Creating volume 486f2c1f-76e7-463d-86be-dd81c67bfda4 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:50 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:50 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 1073741824 Jul 27 13:28:50 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5095d6b4-571f-4ec6-952f-afe8ed39a781 tempest-TestImageHashVerification-1403402539 None] Copy volume to image completed successfully. Jul 27 13:28:51 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 1073741824" returned: 0 in 0.410s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:51 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 Jul 27 13:28:51 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:51 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4" returned: 0 in 0.246s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e71ade-ea5e-4659-8d99-a0139292bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486f2c1f-76e7-463d-86be-dd81c67bfda4', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f7dd0b-fbe8-4e4a-9559-8bc9afc62671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Volume volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 (486f2c1f-76e7-463d-86be-dd81c67bfda4): created successfully Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f7dd0b-fbe8-4e4a-9559-8bc9afc62671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Flow 'volume_create_manager' (583d570c-e6fa-4bf1-b1db-1fef63a26cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:51 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-62ce73e7-ddb5-44bc-b605-bd9ae4c3d080 tempest-CinderUnicodeTest-71558498 None] Created volume successfully. Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Acquiring lock "cinder-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Lock "cinder-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Acquiring lock "cinder-quobyte-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Lock "cinder-quobyte-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" acquired by "delete_volume" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1041057-4bee-4e38-9ab6-213de40f7daa]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:51 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d Jul 27 13:28:51 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:52 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" returned: 0 in 0.384s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:52 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d Jul 27 13:28:52 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Flow 'volume_create_manager' (da99facb-5510-4df7-b148-65758ebcdd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc71eb6-5234-4da8-92b9-653307eccd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc71eb6-5234-4da8-92b9-653307eccd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1488136598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225451eb-f690-4811-88d5-fb2ca25fd41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c908e3e46c4327a6a71dbb2524a6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:52Z,use_quota=True,user_id='e8f90c9a2ff24e25818010a052b8d7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98469aef-500d-4472-82a7-f71766719c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98469aef-500d-4472-82a7-f71766719c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd3ffdc-f427-423e-be79-b58ffecd0305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd3ffdc-f427-423e-be79-b58ffecd0305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225451eb-f690-4811-88d5-fb2ca25fd41b', 'volume_name': 'volume-225451eb-f690-4811-88d5-fb2ca25fd41b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6790962-45c6-4594-8eee-d01f74677b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6790962-45c6-4594-8eee-d01f74677b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6e0b7b-9c14-408e-aaf9-ca189fc20cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Volume 225451eb-f690-4811-88d5-fb2ca25fd41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225451eb-f690-4811-88d5-fb2ca25fd41b', 'volume_size': 1} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:28:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1488136598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225451eb-f690-4811-88d5-fb2ca25fd41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c908e3e46c4327a6a71dbb2524a6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:28:52Z,use_quota=True,user_id='e8f90c9a2ff24e25818010a052b8d7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Creating volume 225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:28:52 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:52 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b 1073741824 Jul 27 13:28:52 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:52 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" returned: 0 in 0.275s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Lock "cinder-quobyte-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d" released by "delete_volume" :: held 0.699s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Created reservations ['9a979a85-04dd-4f8f-add8-e45dd2deb0b0', '5ddefdbd-f92a-4bcc-8901-4ef84d0460c4', '4af7fe20-1ada-4d57-aa67-d5c658cec521', '1d700ea4-7e74-4e9c-bf03-66c8e84445f0'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:52 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:28:52 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:52 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b 1073741824" returned: 0 in 0.453s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:52 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.299s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:28:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Deleted volume successfully. Jul 27 13:28:52 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b Jul 27 13:28:52 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-a25855b3-d9b1-45d7-aae9-a0f76ca567bf tempest-TestImageHashVerification-1403402539 None] Lock "cinder-ee020da0-8d8b-4df6-9b7f-613ca1aeff6d-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:53 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b" returned: 0 in 0.282s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6e0b7b-9c14-408e-aaf9-ca189fc20cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225451eb-f690-4811-88d5-fb2ca25fd41b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc7624f-564f-4afe-95ae-b88dc7ba8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:28:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Volume volume-225451eb-f690-4811-88d5-fb2ca25fd41b (225451eb-f690-4811-88d5-fb2ca25fd41b): created successfully Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc7624f-564f-4afe-95ae-b88dc7ba8690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:28:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Flow 'volume_create_manager' (da99facb-5510-4df7-b148-65758ebcdd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:28:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-785c5253-669c-4a6a-acec-b2215119a746 tempest-CinderUnicodeTest-71558498 None] Created volume successfully. Jul 27 13:28:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:28:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:28:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Creating offline snapshot 061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 of volume 225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:28:54 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aec267-3236-4c33-9aba-b2e75bb10c73]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:54 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b Jul 27 13:28:54 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:55 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:55 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 1G Jul 27 13:28:55 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:55 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 1G" returned: 0 in 0.456s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225451eb-f690-4811-88d5-fb2ca25fd41b -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:55 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225451eb-f690-4811-88d5-fb2ca25fd41b -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 Jul 27 13:28:55 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:55 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225451eb-f690-4811-88d5-fb2ca25fd41b -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:55 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 is being set with open permissions: ugo+rw Jul 27 13:28:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:55 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 Jul 27 13:28:55 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:56 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:56 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info Jul 27 13:28:56 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:56 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info" returned: 0 in 0.287s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:56 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info is being set with open permissions: ugo+rw Jul 27 13:28:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:56 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info Jul 27 13:28:56 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:56 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.info" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:28:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-29ad7cd5-3a0c-4908-8b67-60d248731e4b tempest-CinderUnicodeTest-71558498 None] Create snapshot completed successfully Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Lock "cinder-061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-quobyte-225451eb-f690-4811-88d5-fb2ca25fd41b" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-225451eb-f690-4811-88d5-fb2ca25fd41b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-quobyte-061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Deleting offline snapshot 061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 of volume 225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] snapshot_file for this snap is: volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d0f16-d11b-4cc1-b8c2-48097bec424d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:58 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 Jul 27 13:28:58 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:58 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" returned: 0 in 0.364s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225451eb-f690-4811-88d5-fb2ca25fd41b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:28:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[856d7e65-50af-4b7b-a733-32a5deb9819e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:28:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:58 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b Jul 27 13:28:58 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:58 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:58 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 Jul 27 13:28:58 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:59 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" returned: 0 in 0.390s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:28:59 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2 Jul 27 13:28:59 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:28:59 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b.061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" returned: 0 in 0.258s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2" released by "_delete_snapshot" :: held 1.524s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-225451eb-f690-4811-88d5-fb2ca25fd41b" released by "delete_snapshot" :: held 1.552s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Created reservations ['6cf60d65-3818-44a8-97dd-d350b01659d1', '5ec2e687-8f6a-4d16-9e8d-1700385f00f2', 'd94f0016-95fe-4f7e-b619-b2dab7da76cb', '1692d473-9407-498b-9493-1d243fe3d947'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:28:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Delete snapshot completed successfully. Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fbb23208-6b0f-4735-a324-93435717ab61 tempest-CinderUnicodeTest-71558498 None] Lock "cinder-061fb132-f6eb-44bf-bb7c-8ae4bd26fcb2-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:28:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-225451eb-f690-4811-88d5-fb2ca25fd41b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Lock "cinder-225451eb-f690-4811-88d5-fb2ca25fd41b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-quobyte-225451eb-f690-4811-88d5-fb2ca25fd41b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-225451eb-f690-4811-88d5-fb2ca25fd41b" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed1d82-6619-4758-aca8-265f03b64992]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:00 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b Jul 27 13:29:00 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:00 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b" returned: 0 in 0.385s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:00 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b Jul 27 13:29:00 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:00 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-225451eb-f690-4811-88d5-fb2ca25fd41b" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-225451eb-f690-4811-88d5-fb2ca25fd41b" released by "delete_volume" :: held 0.703s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Created reservations ['70805cf9-f682-453e-8a4b-0cd5ec911659', '3de8769a-7ac7-4172-8907-f6fa6669ff29', '03fbbcfa-9777-4030-a9a2-057001700bf9', '6378dfde-1f57-4438-9ff8-9c50287b1f54'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:00 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:00 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-486f2c1f-76e7-463d-86be-dd81c67bfda4-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Lock "cinder-486f2c1f-76e7-463d-86be-dd81c67bfda4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:01 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Deleted volume successfully. Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Acquiring lock "cinder-quobyte-486f2c1f-76e7-463d-86be-dd81c67bfda4" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d2357153-f156-41f0-9461-ee51f22e7bed tempest-CinderUnicodeTest-71558498 None] Lock "cinder-225451eb-f690-4811-88d5-fb2ca25fd41b-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-486f2c1f-76e7-463d-86be-dd81c67bfda4" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d2fc5-cede-401c-acda-53c077ae3ec2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:01 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 Jul 27 13:29:01 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:01 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4" returned: 0 in 0.395s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:01 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4 Jul 27 13:29:01 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:01 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-486f2c1f-76e7-463d-86be-dd81c67bfda4" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Lock "cinder-quobyte-486f2c1f-76e7-463d-86be-dd81c67bfda4" released by "delete_volume" :: held 0.695s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:01 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Created reservations ['a31b5678-1d43-4728-919b-02c8c3aebd9d', 'a0b7b82d-9804-47b8-86d4-63540fed9e37', 'fce95762-0cad-4aae-a989-2a9f29992c41', '62f8a1f4-5ecf-47b6-bd2e-7785195e1cb6'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:02 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:02 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:02 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.278s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:02 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Deleted volume successfully. Jul 27 13:29:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f01753cb-f364-4bf6-ab38-23a5b012f46b tempest-CinderUnicodeTest-71558498 None] Lock "cinder-486f2c1f-76e7-463d-86be-dd81c67bfda4-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Flow 'volume_create_manager' (90c5c0dc-d4a9-4a0f-8825-9a6ae25145a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e2089e-59dc-4bb6-b02c-ebf6a8420dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e2089e-59dc-4bb6-b02c-ebf6a8420dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139026018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5e5bfd-8f22-4e67-a396-f09f65941d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ef2ba86df4c13b163d5791ad7d6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:04Z,use_quota=True,user_id='771d28f287a84a95b3847e67f7a05153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b4547e-50d9-470a-9903-ca9554e1c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b4547e-50d9-470a-9903-ca9554e1c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eac76c7-665c-4b73-be18-07944d40e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eac76c7-665c-4b73-be18-07944d40e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f5e5bfd-8f22-4e67-a396-f09f65941d72', 'volume_name': 'volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f868c80e-ef8a-46c9-b854-cb3d0334dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f868c80e-ef8a-46c9-b854-cb3d0334dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d60544a-88f5-4045-b542-19ef7e352bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:03 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Volume 7f5e5bfd-8f22-4e67-a396-f09f65941d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72', 'volume_size': 1} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139026018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5e5bfd-8f22-4e67-a396-f09f65941d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ef2ba86df4c13b163d5791ad7d6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:04Z,use_quota=True,user_id='771d28f287a84a95b3847e67f7a05153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Creating volume 7f5e5bfd-8f22-4e67-a396-f09f65941d72 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:03 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:03 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 1073741824 Jul 27 13:29:03 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:04 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 1073741824" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:04 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 Jul 27 13:29:04 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:04 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72" returned: 0 in 0.238s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d60544a-88f5-4045-b542-19ef7e352bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1842679c-0d07-4ede-881f-08eb39dbf109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Volume volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 (7f5e5bfd-8f22-4e67-a396-f09f65941d72): created successfully Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1842679c-0d07-4ede-881f-08eb39dbf109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Flow 'volume_create_manager' (90c5c0dc-d4a9-4a0f-8825-9a6ae25145a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ae7c28be-f4e5-46ef-8483-83b7e7d5e089 tempest-ProjectReaderTests-2045754526 None] Created volume successfully. Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "cinder-7f5e5bfd-8f22-4e67-a396-f09f65941d72-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Lock "cinder-7f5e5bfd-8f22-4e67-a396-f09f65941d72-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "cinder-quobyte-7f5e5bfd-8f22-4e67-a396-f09f65941d72" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Lock "cinder-quobyte-7f5e5bfd-8f22-4e67-a396-f09f65941d72" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a1bf99-93d0-4ca2-aab0-f4dcee62493b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:05 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 Jul 27 13:29:05 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:05 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72" returned: 0 in 0.349s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:05 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72 Jul 27 13:29:05 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:05 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7f5e5bfd-8f22-4e67-a396-f09f65941d72" returned: 0 in 0.242s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Lock "cinder-quobyte-7f5e5bfd-8f22-4e67-a396-f09f65941d72" released by "delete_volume" :: held 0.627s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Created reservations ['a48ac0a9-b690-40ac-8f16-3aae233d3c58', '4cb955cf-6ee6-43a6-b720-3cbef655b78e', '0c014123-c165-4553-b592-b629d82599d8', '907328c7-a427-4a42-b098-3d323f875a26'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:05 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:05 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:05 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.244s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:05 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Deleted volume successfully. Jul 27 13:29:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94128dd1-983d-4050-beae-15567d7bd369 tempest-ProjectReaderTests-2045754526 None] Lock "cinder-7f5e5bfd-8f22-4e67-a396-f09f65941d72-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Flow 'volume_create_manager' (db6e3789-666f-414a-8570-778fba4ac545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2e5d36-2a62-4384-89c4-a44f7ef016a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2e5d36-2a62-4384-89c4-a44f7ef016a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178424475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ef2ba86df4c13b163d5791ad7d6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:06Z,use_quota=True,user_id='771d28f287a84a95b3847e67f7a05153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33048c97-14d2-4b55-8c1e-e4a24c915f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33048c97-14d2-4b55-8c1e-e4a24c915f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbbb48d-72df-45e0-8fec-6f9208230c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbbb48d-72df-45e0-8fec-6f9208230c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973', 'volume_name': 'volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0cf32c-332b-47c4-b966-09ec20b71f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0cf32c-332b-47c4-b966-09ec20b71f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5640b4c8-0ea8-4062-bb5f-d0c0dd57ed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:06 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Volume cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973', 'volume_size': 1} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178424475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ef2ba86df4c13b163d5791ad7d6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:06Z,use_quota=True,user_id='771d28f287a84a95b3847e67f7a05153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Creating volume cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:06 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:06 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 1073741824 Jul 27 13:29:06 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:06 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 1073741824" returned: 0 in 0.398s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:07 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 Jul 27 13:29:07 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:07 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973" returned: 0 in 0.242s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5640b4c8-0ea8-4062-bb5f-d0c0dd57ed3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23703bc5-7cc3-4fd0-bfa3-dbc2126f8a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:07 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Volume volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 (cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973): created successfully Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23703bc5-7cc3-4fd0-bfa3-dbc2126f8a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Flow 'volume_create_manager' (db6e3789-666f-414a-8570-778fba4ac545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2b3a8252-667c-4efc-9b3a-426fa93ca5e9 tempest-ProjectReaderTests-2045754526 None] Created volume successfully. Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Acquiring lock "cinder-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Lock "cinder-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Acquiring lock "cinder-quobyte-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Lock "cinder-quobyte-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dabd43-da06-4b63-81e6-553d978d4c67]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:07 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 Jul 27 13:29:07 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:07 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973" returned: 0 in 0.354s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:07 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973 Jul 27 13:29:07 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:08 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973" returned: 0 in 0.245s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Lock "cinder-quobyte-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973" released by "delete_volume" :: held 0.636s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Created reservations ['0aa3d6d0-49c1-4923-b7fe-3365cd1d68ab', '4c54f9ad-ad0e-47ea-b6f3-40c1ba22f835', 'ee893946-ad04-43bd-82b4-5a2e19fdee76', '98118548-6c28-4af7-b3f8-01481d7b1cdd'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:08 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:08 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:08 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.240s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Deleted volume successfully. Jul 27 13:29:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c50bc8cf-7702-4ca6-acda-0e22d6d177ff tempest-ProjectReaderTests-2045754526 None] Lock "cinder-cd5f6aa1-1c6c-42c0-bfd1-a80d748b2973-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=40,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=5 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:29:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=44,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=5 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (b7973674-04f4-4dc8-98d5-0d9597b610c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8e954b-3112-49d7-bf41-886cb1bfed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8e954b-3112-49d7-bf41-886cb1bfed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1614790140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b058b1-b1b9-4aa6-8660-c17de5ed9bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:25Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01152059-39c0-4cb0-9872-1c6eb73a10e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01152059-39c0-4cb0-9872-1c6eb73a10e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01d9913-0760-42ee-b239-571536e1da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01d9913-0760-42ee-b239-571536e1da3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b058b1-b1b9-4aa6-8660-c17de5ed9bfd', 'volume_name': 'volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b15a4e-807a-4a30-ba90-df068d9588c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b15a4e-807a-4a30-ba90-df068d9588c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29c4054-c01d-413a-845e-dda5c66ff0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume 26b058b1-b1b9-4aa6-8660-c17de5ed9bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd', 'volume_size': 1} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1614790140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b058b1-b1b9-4aa6-8660-c17de5ed9bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:25Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating volume 26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:24 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:24 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd 1073741824 Jul 27 13:29:24 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (2b3797d4-2f8c-4f9c-b912-6d95366c66e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936c94d9-9e67-47b9-b441-ff5f1a0e94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936c94d9-9e67-47b9-b441-ff5f1a0e94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1646381004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2f9e4d-66b0-4466-a321-6c73dd214c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:25Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0681c8-2734-4361-af94-05d1ed295c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0681c8-2734-4361-af94-05d1ed295c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d789d6a-026b-440b-a1e1-7d19d9a13a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d789d6a-026b-440b-a1e1-7d19d9a13a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2f9e4d-66b0-4466-a321-6c73dd214c43', 'volume_name': 'volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926d2c6b-c8f0-4438-bf33-68734e5f4ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926d2c6b-c8f0-4438-bf33-68734e5f4ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0662d5a1-c8d2-4ce4-8d49-1b289769bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Volume 1b2f9e4d-66b0-4466-a321-6c73dd214c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43', 'volume_size': 1} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (558596f0-3cf6-4503-965c-88cc52bd9919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86216fbe-ca69-45bd-884b-9a228f780143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86216fbe-ca69-45bd-884b-9a228f780143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1954060995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944a4105-1c19-4b97-aef3-fdc357108ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:25Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c68df3d-8e1b-40a4-83b1-f5eff9f2579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c68df3d-8e1b-40a4-83b1-f5eff9f2579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc562db-1489-4d96-b15d-9d5d584fd2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc562db-1489-4d96-b15d-9d5d584fd2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944a4105-1c19-4b97-aef3-fdc357108ba5', 'volume_name': 'volume-944a4105-1c19-4b97-aef3-fdc357108ba5', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30a0506-9ba6-4e3a-9556-5ef704030b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30a0506-9ba6-4e3a-9556-5ef704030b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e409c9-d63f-43b1-bec4-47f49efa6d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Volume 944a4105-1c19-4b97-aef3-fdc357108ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944a4105-1c19-4b97-aef3-fdc357108ba5', 'volume_size': 1} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:25 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd 1073741824" returned: 0 in 0.805s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:25 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd Jul 27 13:29:25 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (c084c8d8-fefc-4efe-ba87-5ebc5f470550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb7c523-7e74-49cb-b4e5-a4727e8fa403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb7c523-7e74-49cb-b4e5-a4727e8fa403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2058060836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e944202-aca7-4bce-a7b2-48b0a316bd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:26Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7810c398-44c3-492e-8cf1-197bfce01146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7810c398-44c3-492e-8cf1-197bfce01146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7f8338-ed0c-45e5-8025-00fd14df88a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7f8338-ed0c-45e5-8025-00fd14df88a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e944202-aca7-4bce-a7b2-48b0a316bd93', 'volume_name': 'volume-7e944202-aca7-4bce-a7b2-48b0a316bd93', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94492a49-4fdd-4e1a-8968-c20d2a4f83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94492a49-4fdd-4e1a-8968-c20d2a4f83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81f0174-dd66-4f3f-83ff-6d3f59b87958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Volume 7e944202-aca7-4bce-a7b2-48b0a316bd93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e944202-aca7-4bce-a7b2-48b0a316bd93', 'volume_size': 1} Jul 27 13:29:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:26 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" returned: 0 in 0.316s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1646381004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2f9e4d-66b0-4466-a321-6c73dd214c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:25Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Creating volume 1b2f9e4d-66b0-4466-a321-6c73dd214c43 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:26 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29c4054-c01d-413a-845e-dda5c66ff0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:26 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 1073741824 Jul 27 13:29:26 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267d2b9f-c8bb-479f-adc9-d96d81d79440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:26 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd (26b058b1-b1b9-4aa6-8660-c17de5ed9bfd): created successfully Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267d2b9f-c8bb-479f-adc9-d96d81d79440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (b7973674-04f4-4dc8-98d5-0d9597b610c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:26 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d31e7f62-64e4-4b11-9356-c5996c2b31ec tempest-CreateVolumesFromSnapshotTest-541055521 None] Created volume successfully. Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (69db5783-58e0-475a-9cd9-bee72c0c4f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec440fc-78e3-49b7-bbed-f896ff1824c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec440fc-78e3-49b7-bbed-f896ff1824c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856773697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece3fa16-d0a9-45d0-a824-7b306552ace9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:26Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cae333-69fb-4a89-bc8d-e41be7f0a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cae333-69fb-4a89-bc8d-e41be7f0a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbc4a51-90dc-4fda-86f4-192949896e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbc4a51-90dc-4fda-86f4-192949896e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece3fa16-d0a9-45d0-a824-7b306552ace9', 'volume_name': 'volume-ece3fa16-d0a9-45d0-a824-7b306552ace9', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee192ba-68e4-47be-8585-07a114e6e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee192ba-68e4-47be-8585-07a114e6e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3334ebb7-6493-4b1a-8828-27efd635afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:26 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Volume ece3fa16-d0a9-45d0-a824-7b306552ace9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece3fa16-d0a9-45d0-a824-7b306552ace9', 'volume_size': 1} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:26 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 1073741824" returned: 0 in 0.626s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:26 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 Jul 27 13:29:26 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:27 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (985f11ec-cd0d-467b-b5c0-482e36c764d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c697dfb3-ea32-446d-ba51-adfffbb9a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43" returned: 0 in 0.405s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.749s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1954060995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944a4105-1c19-4b97-aef3-fdc357108ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:25Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Creating volume 944a4105-1c19-4b97-aef3-fdc357108ba5 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:27 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c697dfb3-ea32-446d-ba51-adfffbb9a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055896955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccc1201-1350-45f0-9970-fae8a4940831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:27Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c586ea72-9f01-41fb-b952-24fed4743a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:27 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 1073741824 Jul 27 13:29:27 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c586ea72-9f01-41fb-b952-24fed4743a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641ed905-c3d8-460e-9a08-71a7ec04e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641ed905-c3d8-460e-9a08-71a7ec04e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ccc1201-1350-45f0-9970-fae8a4940831', 'volume_name': 'volume-8ccc1201-1350-45f0-9970-fae8a4940831', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8727b2-cf1a-4d2f-82af-85181b05df18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8727b2-cf1a-4d2f-82af-85181b05df18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7596247-f62e-4250-b00b-7de9f562dc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:27 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Volume 8ccc1201-1350-45f0-9970-fae8a4940831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ccc1201-1350-45f0-9970-fae8a4940831', 'volume_size': 1} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0662d5a1-c8d2-4ce4-8d49-1b289769bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43411c30-4b07-4c53-ad21-1676a6aa2de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:27 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Volume volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 (1b2f9e4d-66b0-4466-a321-6c73dd214c43): created successfully Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43411c30-4b07-4c53-ad21-1676a6aa2de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (2b3797d4-2f8c-4f9c-b912-6d95366c66e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:27 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0f5237d9-ea71-47b2-aaad-de2af92a1954 tempest-CreateVolumesFromImageTest-2134204736 None] Created volume successfully. Jul 27 13:29:27 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 1073741824" returned: 0 in 0.621s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:27 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 Jul 27 13:29:27 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Flow 'volume_create_manager' (14bd742c-97e3-490d-a20d-c38345f39617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad70caf9-24de-444d-86b3-ac45b5536f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad70caf9-24de-444d-86b3-ac45b5536f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56966410-200c-4ec0-89b9-cc7e34848486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190ec514022b46fcae26192b8af3325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:28Z,use_quota=True,user_id='7e50c91ae3604a12b85f05f2319f956d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25f4feb-dc20-4feb-8b12-9e57778d171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25f4feb-dc20-4feb-8b12-9e57778d171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a49d25-cea8-4913-89d1-f7ae1f04e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:29:28 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5" returned: 0 in 0.346s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2058060836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e944202-aca7-4bce-a7b2-48b0a316bd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:26Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Creating volume 7e944202-aca7-4bce-a7b2-48b0a316bd93 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:28 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e409c9-d63f-43b1-bec4-47f49efa6d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944a4105-1c19-4b97-aef3-fdc357108ba5', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558b5c1a-071a-4c01-a52b-2b5085de51d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:28 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 1073741824 Jul 27 13:29:28 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:28 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Volume volume-944a4105-1c19-4b97-aef3-fdc357108ba5 (944a4105-1c19-4b97-aef3-fdc357108ba5): created successfully Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558b5c1a-071a-4c01-a52b-2b5085de51d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (558596f0-3cf6-4503-965c-88cc52bd9919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cfdded77-c29c-4cd6-8970-ac8649c465f0 tempest-CreateVolumesFromImageTest-2134204736 None] Created volume successfully. Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a49d25-cea8-4913-89d1-f7ae1f04e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56966410-200c-4ec0-89b9-cc7e34848486', 'volume_name': 'volume-56966410-200c-4ec0-89b9-cc7e34848486', 'volume_size': 1, 'image_id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/208581f4-3307-4a64-89e6-5203ef4ae771', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c0e874f79459889fd1439d4cb83faf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '190ec514022b46fcae26192b8af3325d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ac9dfb8f79beb452544d16589c77aa0cc2e91b85ec723786df85bf1408309f96756559050d198b3f39bdb56be57cce56467b82651894f314e57b095fe68901f', 'id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'created_at': datetime.datetime(2026, 7, 27, 11, 29, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 29, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/208581f4-3307-4a64-89e6-5203ef4ae771/file', 'properties': {}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec0c357-ed44-46f9-bea6-05b11f528b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec0c357-ed44-46f9-bea6-05b11f528b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fc667c-959d-4ecc-bc13-44bfa2caf419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:28 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Volume 56966410-200c-4ec0-89b9-cc7e34848486: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56966410-200c-4ec0-89b9-cc7e34848486', 'volume_size': 1, 'image_id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/208581f4-3307-4a64-89e6-5203ef4ae771', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c0e874f79459889fd1439d4cb83faf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '190ec514022b46fcae26192b8af3325d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ac9dfb8f79beb452544d16589c77aa0cc2e91b85ec723786df85bf1408309f96756559050d198b3f39bdb56be57cce56467b82651894f314e57b095fe68901f', 'id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'created_at': datetime.datetime(2026, 7, 27, 11, 29, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 29, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/208581f4-3307-4a64-89e6-5203ef4ae771/file', 'properties': {}}, 'image_service': } Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Trying to clone 56966410-200c-4ec0-89b9-cc7e34848486 from image 208581f4-3307-4a64-89e6-5203ef4ae771 at location (None, [{'url': 'file:///opt/stack/data/glance/images/208581f4-3307-4a64-89e6-5203ef4ae771', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:29:28 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Image download 0.00 MB at 0.00 MB/s Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff7690-b9dd-45ed-b4dc-8f113b4062dd]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:28 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 1073741824" returned: 0 in 0.521s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:28 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD Jul 27 13:29:28 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:28 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 Jul 27 13:29:28 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:28 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:29 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93" returned: 0 in 0.306s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856773697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece3fa16-d0a9-45d0-a824-7b306552ace9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:26Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Creating volume ece3fa16-d0a9-45d0-a824-7b306552ace9 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:29 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD Jul 27 13:29:29 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:29 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81f0174-dd66-4f3f-83ff-6d3f59b87958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e944202-aca7-4bce-a7b2-48b0a316bd93', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3617d3c-045d-42e2-8f58-0339236ace2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:29 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 1073741824 Jul 27 13:29:29 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Volume volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 (7e944202-aca7-4bce-a7b2-48b0a316bd93): created successfully Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3617d3c-045d-42e2-8f58-0339236ace2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (c084c8d8-fefc-4efe-ba87-5ebc5f470550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:29 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-de68da56-b0ff-4b29-af58-cfbe7d53c30d tempest-CreateVolumesFromImageTest-2134204736 None] Created volume successfully. Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Flow 'volume_create_manager' (cc624b59-d554-4002-9b5e-fdca7a852e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:29 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5984bb-58c7-4e76-ad3a-8a3a051a2298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD" returned: 1 in 0.457s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Temporary image 208581f4-3307-4a64-89e6-5203ef4ae771 is fetched for user 7e50c91ae3604a12b85f05f2319f956d. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5984bb-58c7-4e76-ad3a-8a3a051a2298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df1114-7a65-495f-971b-e8c003315a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472e5bf8abf94ef2a2a2ee9e7419db84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:29Z,use_quota=True,user_id='98d78ea24aa74d3da976c47fbf06a542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df561f44-1217-4caa-bab9-ac1471b6af00),volume_type_id=df561f44-1217-4caa-bab9-ac1471b6af00)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01acb352-ff7d-4f98-a65b-2f06967451d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01acb352-ff7d-4f98-a65b-2f06967451d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915369e7-a0bb-4a08-bb11-7a6ef9d820a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.image.glance [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Creating Keystone auth plugin from conf {{(pid=88202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4c587-7c9e-451e-8196-d2913d403541]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:29 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 1073741824" returned: 0 in 0.493s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:29 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD Jul 27 13:29:29 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:29 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 Jul 27 13:29:29 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915369e7-a0bb-4a08-bb11-7a6ef9d820a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95df1114-7a65-495f-971b-e8c003315a83', 'volume_name': 'volume-95df1114-7a65-495f-971b-e8c003315a83', 'volume_size': 1, 'image_id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfb8c311-c9a4-47b9-b695-f391062e39c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca750f8e4b1e6bd06771fd76674bf46', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '472e5bf8abf94ef2a2a2ee9e7419db84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a267ffe216fad4db5f30e0d506886f0e3d763d900ffa0d26ba01fe1552e674c5eed26d107972c8b01dda7dadcebb5a2033526639cb660e888d51694ea69290c4', 'id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'created_at': datetime.datetime(2026, 7, 27, 11, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfb8c311-c9a4-47b9-b695-f391062e39c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949b8771-7700-44a0-b276-7dd23843a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949b8771-7700-44a0-b276-7dd23843a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc5bfd5-22c2-4e18-aa49-c8ec21ca80a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Volume 95df1114-7a65-495f-971b-e8c003315a83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95df1114-7a65-495f-971b-e8c003315a83', 'volume_size': 1, 'image_id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfb8c311-c9a4-47b9-b695-f391062e39c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca750f8e4b1e6bd06771fd76674bf46', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '472e5bf8abf94ef2a2a2ee9e7419db84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a267ffe216fad4db5f30e0d506886f0e3d763d900ffa0d26ba01fe1552e674c5eed26d107972c8b01dda7dadcebb5a2033526639cb660e888d51694ea69290c4', 'id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'created_at': datetime.datetime(2026, 7, 27, 11, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfb8c311-c9a4-47b9-b695-f391062e39c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Trying to clone 95df1114-7a65-495f-971b-e8c003315a83 from image dfb8c311-c9a4-47b9-b695-f391062e39c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfb8c311-c9a4-47b9-b695-f391062e39c4', 'metadata': {}}]). {{(pid=88202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 27 13:29:29 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Image download 0.00 MB at 0.00 MB/s Jul 27 13:29:29 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[285986fb-d6ce-4bcd-a40f-ab266c33fcf5]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:29 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9" returned: 0 in 0.308s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.815s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3334ebb7-6493-4b1a-8828-27efd635afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece3fa16-d0a9-45d0-a824-7b306552ace9', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2f9924-ac2f-45a2-9130-62bd68610e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating offline snapshot 89a1be82-656a-4bce-ad8a-43e38dcd5e67 of volume 26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:29:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Volume volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 (ece3fa16-d0a9-45d0-a824-7b306552ace9): created successfully Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2f9924-ac2f-45a2-9130-62bd68610e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:30 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD Jul 27 13:29:30 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (69db5783-58e0-475a-9cd9-bee72c0c4f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f055b-e45f-4dd2-b35a-3b1396570a87]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7ab5015d-ab16-4def-ae87-54bd70f1bb35 tempest-CreateVolumesFromImageTest-2134204736 None] Created volume successfully. Jul 27 13:29:30 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD Jul 27 13:29:30 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:30 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd Jul 27 13:29:30 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:30 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD" returned: 1 in 0.436s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:30 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:30 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD Jul 27 13:29:30 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:30 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" returned: 0 in 0.468s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:30 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 1G Jul 27 13:29:30 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:30 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Temporary image dfb8c311-c9a4-47b9-b695-f391062e39c4 is fetched for user 98d78ea24aa74d3da976c47fbf06a542. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08baeb-cdea-409d-a8a1-963eda99e080]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:30 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD Jul 27 13:29:30 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:30 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 1G" returned: 0 in 0.424s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:30 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 Jul 27 13:29:30 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:31 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:31 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67" returned: 0 in 0.331s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:31 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 is being set with open permissions: ugo+rw Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:31 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 Jul 27 13:29:31 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:31 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD Jul 27 13:29:31 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:31 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:31 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:31 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info Jul 27 13:29:31 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:31 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info" returned: 0 in 0.250s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:31 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info is being set with open permissions: ugo+rw Jul 27 13:29:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:31 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info Jul 27 13:29:31 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:32 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.info" returned: 0 in 0.245s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.881s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055896955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccc1201-1350-45f0-9970-fae8a4940831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d188dbf3f4e9aae69bade6d2867e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:27Z,use_quota=True,user_id='729eef9213e04265af3b1b277b295a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Creating volume 8ccc1201-1350-45f0-9970-fae8a4940831 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:32 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:32 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 1073741824 Jul 27 13:29:32 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:32 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4c8812e8-0969-4d73-b657-4c0324e9d48d tempest-CreateVolumesFromSnapshotTest-541055521 None] Create snapshot completed successfully Jul 27 13:29:32 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 1073741824" returned: 0 in 0.478s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:32 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 Jul 27 13:29:32 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (8c556e51-07df-4b51-b478-961700299297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d59f74-5d26-4e0a-8dc6-9851569e6180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d59f74-5d26-4e0a-8dc6-9851569e6180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056789284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5211536f-49b8-45cb-902b-5b03f737ab1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:33Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1953fdc-01ba-48f0-8ad9-8fdb28f6ca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1953fdc-01ba-48f0-8ad9-8fdb28f6ca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfe7e8e-2dc7-4148-a213-4f23e17aa253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfe7e8e-2dc7-4148-a213-4f23e17aa253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5211536f-49b8-45cb-902b-5b03f737ab1f', 'volume_name': 'volume-5211536f-49b8-45cb-902b-5b03f737ab1f', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6713254-4f8a-45ac-99ec-bdc7185cebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6713254-4f8a-45ac-99ec-bdc7185cebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a4cad8-44e3-43ac-8ab9-9ac7dd9487d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume 5211536f-49b8-45cb-902b-5b03f737ab1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5211536f-49b8-45cb-902b-5b03f737ab1f', 'volume_size': 1} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:32 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831" returned: 0 in 0.279s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.564s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56966410-200c-4ec0-89b9-cc7e34848486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190ec514022b46fcae26192b8af3325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:28Z,use_quota=True,user_id='7e50c91ae3604a12b85f05f2319f956d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Creating volume 56966410-200c-4ec0-89b9-cc7e34848486 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:32 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7596247-f62e-4250-b00b-7de9f562dc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ccc1201-1350-45f0-9970-fae8a4940831', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:32 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a19b90-7484-4382-85b6-be79fd6bd486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:32 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 1073741824 Jul 27 13:29:32 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:32 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Volume volume-8ccc1201-1350-45f0-9970-fae8a4940831 (8ccc1201-1350-45f0-9970-fae8a4940831): created successfully Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a19b90-7484-4382-85b6-be79fd6bd486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Flow 'volume_create_manager' (985f11ec-cd0d-467b-b5c0-482e36c764d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bc6dfc82-ca63-4364-b9de-e82cb813fc5b tempest-CreateVolumesFromImageTest-2134204736 None] Created volume successfully. Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:33 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:33 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (31393cd6-e372-4581-9afd-8e8e885d0a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3303a5-2fe4-48d3-986d-d77796d479bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3303a5-2fe4-48d3-986d-d77796d479bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1498502231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041410e1-60c5-4f0c-a76a-b67460d8fff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:33Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6c5f4e-4bbd-48b7-b0b8-f1d08a98a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6c5f4e-4bbd-48b7-b0b8-f1d08a98a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00040f1b-d1c3-49e7-8265-227de331651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00040f1b-d1c3-49e7-8265-227de331651b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '041410e1-60c5-4f0c-a76a-b67460d8fff0', 'volume_name': 'volume-041410e1-60c5-4f0c-a76a-b67460d8fff0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417488c2-8a3e-4f9d-b00b-f9520065e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417488c2-8a3e-4f9d-b00b-f9520065e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcf88a3-a2a7-4780-a900-80e8e2b6c76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:33 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume 041410e1-60c5-4f0c-a76a-b67460d8fff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-041410e1-60c5-4f0c-a76a-b67460d8fff0', 'volume_size': 1} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:33 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 1073741824" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.327s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:29:33 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 Jul 27 13:29:33 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-8ccc1201-1350-45f0-9970-fae8a4940831-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:33 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-8ccc1201-1350-45f0-9970-fae8a4940831-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.171s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df1114-7a65-495f-971b-e8c003315a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472e5bf8abf94ef2a2a2ee9e7419db84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:29Z,use_quota=True,user_id='98d78ea24aa74d3da976c47fbf06a542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df561f44-1217-4caa-bab9-ac1471b6af00),volume_type_id=df561f44-1217-4caa-bab9-ac1471b6af00)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Creating volume 95df1114-7a65-495f-971b-e8c003315a83 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:33 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:33 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 1073741824 Jul 27 13:29:33 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Attempting download of 208581f4-3307-4a64-89e6-5203ef4ae771 ((None, [{'url': 'file:///opt/stack/data/glance/images/208581f4-3307-4a64-89e6-5203ef4ae771', 'metadata': {}}])) to volume 56966410-200c-4ec0-89b9-cc7e34848486. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-quobyte-8ccc1201-1350-45f0-9970-fae8a4940831" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-8ccc1201-1350-45f0-9970-fae8a4940831" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f15752-57c3-450c-be56-0db7434dcd04]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b75e035-6e8f-4c98-bcc2-ce9150242a10]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:33 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:34 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 Jul 27 13:29:34 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (e7f26ad7-70e2-436f-976d-d291fbfa6fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b251596-285a-4a7a-a4f7-a3ce07f63937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b251596-285a-4a7a-a4f7-a3ce07f63937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3278093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14818b7e-5b58-4b54-b606-ea3afb14a6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:34Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc61d5d1-350c-4f83-8da5-92585420157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc61d5d1-350c-4f83-8da5-92585420157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb932805-88e2-427f-914a-32f97c14aafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb932805-88e2-427f-914a-32f97c14aafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14818b7e-5b58-4b54-b606-ea3afb14a6e0', 'volume_name': 'volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193c6dfd-e21d-4a3b-bcd2-8e72f6938c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193c6dfd-e21d-4a3b-bcd2-8e72f6938c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b598e80-aeee-4d19-a05d-3bf7a2edee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume 14818b7e-5b58-4b54-b606-ea3afb14a6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0', 'volume_size': 1} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:34 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s Jul 27 13:29:34 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:34 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (6a963baf-dadc-4b37-8eb1-d4eca5082769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991df99b-1fae-40dd-8760-270c8f073625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 1073741824" returned: 0 in 0.667s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991df99b-1fae-40dd-8760-270c8f073625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583172799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62867318-2583-415b-a624-b13849d0ac04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:34Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550023cf-0d04-40dd-ad4e-692043022115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550023cf-0d04-40dd-ad4e-692043022115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b828f-7a2d-4801-bc41-224a8dc9b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b828f-7a2d-4801-bc41-224a8dc9b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62867318-2583-415b-a624-b13849d0ac04', 'volume_name': 'volume-62867318-2583-415b-a624-b13849d0ac04', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2ee3f7-2531-4675-9ddd-70a4d843c8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2ee3f7-2531-4675-9ddd-70a4d843c8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52711e18-2ab1-4ebd-a452-9e96a4d68829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume 62867318-2583-415b-a624-b13849d0ac04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62867318-2583-415b-a624-b13849d0ac04', 'volume_size': 1} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s" returned: 0 in 0.545s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831" returned: 0 in 0.613s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:34 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831 Jul 27 13:29:34 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:34 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 Jul 27 13:29:34 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:34 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s Jul 27 13:29:34 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:34 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:34 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (438f83ac-d3c1-4cb1-b396-ea5b7dd0b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021a984c-2db7-473c-aacf-4c571e9eba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83" returned: 0 in 0.387s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8ccc1201-1350-45f0-9970-fae8a4940831" returned: 0 in 0.425s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.038s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056789284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5211536f-49b8-45cb-902b-5b03f737ab1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:33Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating volume 5211536f-49b8-45cb-902b-5b03f737ab1f {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:34 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:34 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021a984c-2db7-473c-aacf-4c571e9eba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1316044300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5ef896-27b2-4658-bffa-2f4adeafc74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:35Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd9fd8f-d1a6-4da0-8167-2281b7efcc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:34 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f 1073741824 Jul 27 13:29:34 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd9fd8f-d1a6-4da0-8167-2281b7efcc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c58873-77e1-431c-b140-f59da131fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c58873-77e1-431c-b140-f59da131fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5ef896-27b2-4658-bffa-2f4adeafc74c', 'volume_name': 'volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ecd321-99a4-40bf-8d74-c5b095d64193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ecd321-99a4-40bf-8d74-c5b095d64193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475be300-f74b-461c-92ed-c55bc345b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:35 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume dc5ef896-27b2-4658-bffa-2f4adeafc74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c', 'volume_size': 1} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-8ccc1201-1350-45f0-9970-fae8a4940831" released by "delete_volume" :: held 1.176s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s" returned: 1 in 0.530s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_208581f4-3307-4a64-89e6-5203ef4ae771_xgueyf5s' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28b3a5c-6392-4d9a-a9e2-f60dc25bf2f7]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Attempting download of dfb8c311-c9a4-47b9-b695-f391062e39c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfb8c311-c9a4-47b9-b695-f391062e39c4', 'metadata': {}}])) to volume 95df1114-7a65-495f-971b-e8c003315a83. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Created reservations ['dd787176-f7d2-4c3b-a1c8-5a1094cfcce0', '58ba0888-1c90-47d4-977b-b39795450752', 'ef924f4c-3e6f-4b9d-a1aa-809cb6526acf', 'ce0bf338-0b47-4642-8fda-ad0d6a64f2f6'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954c949-8c7c-451a-b1fa-5ce3055e9ebf]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD Jul 27 13:29:35 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8 Jul 27 13:29:35 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:35 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f 1073741824" returned: 0 in 0.585s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8" returned: 0 in 0.432s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Deleted volume successfully. Jul 27 13:29:35 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD Jul 27 13:29:35 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7460d7f6-900e-4250-b49a-29300b468f7d tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-8ccc1201-1350-45f0-9970-fae8a4940831-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:35 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f Jul 27 13:29:35 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8 Jul 27 13:29:35 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] 208581f4-3307-4a64-89e6-5203ef4ae771 was raw, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:35 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 Jul 27 13:29:35 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:35 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f" returned: 0 in 0.337s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1498502231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041410e1-60c5-4f0c-a76a-b67460d8fff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:33Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating volume 041410e1-60c5-4f0c-a76a-b67460d8fff0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:35 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8" returned: 1 in 0.452s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb8c311-c9a4-47b9-b695-f391062e39c4_qnzg21n8' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a51454-02a9-4c93-9d08-60caac42c216]: (4, 'raw') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 1073741824 Jul 27 13:29:36 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a4cad8-44e3-43ac-8ab9-9ac7dd9487d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5211536f-49b8-45cb-902b-5b03f737ab1f', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01e4a79-1744-4f8c-ab98-be6c6cc8e1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-ece3fa16-d0a9-45d0-a824-7b306552ace9-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:36 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume volume-5211536f-49b8-45cb-902b-5b03f737ab1f (5211536f-49b8-45cb-902b-5b03f737ab1f): created successfully Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01e4a79-1744-4f8c-ab98-be6c6cc8e1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (8c556e51-07df-4b51-b478-961700299297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-ece3fa16-d0a9-45d0-a824-7b306552ace9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:36 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-64e059b4-fc5f-437d-8c8f-54dd3a96077a tempest-CreateVolumesFromSnapshotTest-541055521 None] Created volume successfully. Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-quobyte-ece3fa16-d0a9-45d0-a824-7b306552ace9" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-ece3fa16-d0a9-45d0-a824-7b306552ace9" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b07db0-1e6b-4729-a20e-131666fc4f0d]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD Jul 27 13:29:36 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 Jul 27 13:29:36 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486" returned: 0 in 0.502s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_208581f4-3307-4a64-89e6-5203ef4ae771__d05clc1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:29:36 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Converted 0.00 MB image at 0.00 MB/s Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 1G Jul 27 13:29:36 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 1073741824" returned: 0 in 0.522s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD Jul 27 13:29:36 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 Jul 27 13:29:36 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9" returned: 0 in 0.460s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9 Jul 27 13:29:36 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 1G" returned: 0 in 0.367s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Downloaded image 208581f4-3307-4a64-89e6-5203ef4ae771 ((None, [{'url': 'file:///opt/stack/data/glance/images/208581f4-3307-4a64-89e6-5203ef4ae771', 'metadata': {}}])) to volume 56966410-200c-4ec0-89b9-cc7e34848486 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Temporary image 208581f4-3307-4a64-89e6-5203ef4ae771 for user 7e50c91ae3604a12b85f05f2319f956d is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Marking volume 56966410-200c-4ec0-89b9-cc7e34848486 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Copying metadata from image 208581f4-3307-4a64-89e6-5203ef4ae771 to 56966410-200c-4ec0-89b9-cc7e34848486. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Creating volume glance metadata for volume 56966410-200c-4ec0-89b9-cc7e34848486 backed by image 208581f4-3307-4a64-89e6-5203ef4ae771 with: {'image_id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c0e874f79459889fd1439d4cb83faf7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:29:36 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD" returned: 1 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] dfb8c311-c9a4-47b9-b695-f391062e39c4 was raw, converting to qcow2 {{(pid=88202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:36 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 Jul 27 13:29:36 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:36 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fc667c-959d-4ecc-bc13-44bfa2caf419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56966410-200c-4ec0-89b9-cc7e34848486', 'volume_size': 1, 'image_id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/208581f4-3307-4a64-89e6-5203ef4ae771', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c0e874f79459889fd1439d4cb83faf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '190ec514022b46fcae26192b8af3325d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ac9dfb8f79beb452544d16589c77aa0cc2e91b85ec723786df85bf1408309f96756559050d198b3f39bdb56be57cce56467b82651894f314e57b095fe68901f', 'id': '208581f4-3307-4a64-89e6-5203ef4ae771', 'created_at': datetime.datetime(2026, 7, 27, 11, 29, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 29, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/208581f4-3307-4a64-89e6-5203ef4ae771/file', 'properties': {}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193bfd84-4607-491d-9b2e-0572e60211c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3278093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14818b7e-5b58-4b54-b606-ea3afb14a6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:34Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating volume 14818b7e-5b58-4b54-b606-ea3afb14a6e0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:36 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcf88a3-a2a7-4780-a900-80e8e2b6c76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041410e1-60c5-4f0c-a76a-b67460d8fff0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfca230-ebba-41a6-be61-d1299144b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:37 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 1073741824 Jul 27 13:29:37 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ece3fa16-d0a9-45d0-a824-7b306552ace9" returned: 0 in 0.358s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Volume volume-56966410-200c-4ec0-89b9-cc7e34848486 (56966410-200c-4ec0-89b9-cc7e34848486): created successfully Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193bfd84-4607-491d-9b2e-0572e60211c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Flow 'volume_create_manager' (14bd742c-97e3-490d-a20d-c38345f39617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 (041410e1-60c5-4f0c-a76a-b67460d8fff0): created successfully Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfca230-ebba-41a6-be61-d1299144b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (31393cd6-e372-4581-9afd-8e8e885d0a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-ece3fa16-d0a9-45d0-a824-7b306552ace9" released by "delete_volume" :: held 0.906s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cce0bed7-37f6-4972-8689-379e9503189a tempest-VolumeImageDependencyTests-1079731453 None] Created volume successfully. Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d1e71289-3e8b-4bc7-9772-7a05f6007e85 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created volume successfully. Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Created reservations ['12cefb1a-114b-4a28-872e-0ba3b0fa4d4b', 'f195c21c-c408-43fe-8ab3-060b151b586d', 'b00ae8b1-43ce-4829-a916-9765ed4300a9', '5b4fa15c-1fd4-415d-a93e-3dfb0e4d0614'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:37 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-7e944202-aca7-4bce-a7b2-48b0a316bd93-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-7e944202-aca7-4bce-a7b2-48b0a316bd93-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-quobyte-7e944202-aca7-4bce-a7b2-48b0a316bd93" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-7e944202-aca7-4bce-a7b2-48b0a316bd93" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bf3e4b-508d-4c79-89cb-739f72da67c1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.288s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Deleted volume successfully. Jul 27 13:29:37 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83" returned: 0 in 0.589s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfb8c311-c9a4-47b9-b695-f391062e39c4_jqxi2n_3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Converted 0.00 MB image at 0.00 MB/s Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 1073741824" returned: 0 in 0.535s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 1G Jul 27 13:29:37 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-28a4417d-a15a-47bc-82ee-d6e26c62ab30 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-ece3fa16-d0a9-45d0-a824-7b306552ace9-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:37 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 Jul 27 13:29:37 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 Jul 27 13:29:37 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:37 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 1G" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Downloaded image dfb8c311-c9a4-47b9-b695-f391062e39c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfb8c311-c9a4-47b9-b695-f391062e39c4', 'metadata': {}}])) to volume 95df1114-7a65-495f-971b-e8c003315a83 successfully. {{(pid=88202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Temporary image dfb8c311-c9a4-47b9-b695-f391062e39c4 for user 98d78ea24aa74d3da976c47fbf06a542 is deleted. {{(pid=88202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.volume_utils [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Marking volume 95df1114-7a65-495f-971b-e8c003315a83 as bootable. {{(pid=88202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93" returned: 0 in 0.470s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Acquiring lock "cinder-56966410-200c-4ec0-89b9-cc7e34848486-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0" returned: 0 in 0.349s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:37 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93 Jul 27 13:29:37 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.431s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583172799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62867318-2583-415b-a624-b13849d0ac04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:34Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating volume 62867318-2583-415b-a624-b13849d0ac04 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:37 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Copying metadata from image dfb8c311-c9a4-47b9-b695-f391062e39c4 to 95df1114-7a65-495f-971b-e8c003315a83. {{(pid=88202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 27 13:29:37 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Creating volume glance metadata for volume 95df1114-7a65-495f-971b-e8c003315a83 backed by image dfb8c311-c9a4-47b9-b695-f391062e39c4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4ca750f8e4b1e6bd06771fd76674bf46', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b598e80-aeee-4d19-a05d-3bf7a2edee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:38 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 1073741824 Jul 27 13:29:38 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9873476-d939-40b2-b9a1-247724c7651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Lock "cinder-56966410-200c-4ec0-89b9-cc7e34848486-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 (14818b7e-5b58-4b54-b606-ea3afb14a6e0): created successfully Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9873476-d939-40b2-b9a1-247724c7651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (e7f26ad7-70e2-436f-976d-d291fbfa6fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ace71c66-374a-4a3f-b887-ec646da1a307 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created volume successfully. Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Acquiring lock "cinder-quobyte-56966410-200c-4ec0-89b9-cc7e34848486" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc5bfd5-22c2-4e18-aa49-c8ec21ca80a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95df1114-7a65-495f-971b-e8c003315a83', 'volume_size': 1, 'image_id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfb8c311-c9a4-47b9-b695-f391062e39c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca750f8e4b1e6bd06771fd76674bf46', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '472e5bf8abf94ef2a2a2ee9e7419db84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a267ffe216fad4db5f30e0d506886f0e3d763d900ffa0d26ba01fe1552e674c5eed26d107972c8b01dda7dadcebb5a2033526639cb660e888d51694ea69290c4', 'id': 'dfb8c311-c9a4-47b9-b695-f391062e39c4', 'created_at': datetime.datetime(2026, 7, 27, 11, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 27, 11, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfb8c311-c9a4-47b9-b695-f391062e39c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a55b54-8d02-44b1-9e0e-245415f7a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Volume volume-95df1114-7a65-495f-971b-e8c003315a83 (95df1114-7a65-495f-971b-e8c003315a83): created successfully Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a55b54-8d02-44b1-9e0e-245415f7a697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Flow 'volume_create_manager' (cc624b59-d554-4002-9b5e-fdca7a852e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Lock "cinder-quobyte-56966410-200c-4ec0-89b9-cc7e34848486" acquired by "delete_volume" :: waited 0.078s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6a5e3771-283a-4c85-930a-aaea13fe099c tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Created volume successfully. Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a89450-20fd-406a-a572-14c778e34e92]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:38 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-7e944202-aca7-4bce-a7b2-48b0a316bd93" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-7e944202-aca7-4bce-a7b2-48b0a316bd93" released by "delete_volume" :: held 0.880s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Created reservations ['18d2b53f-b469-4fc1-ad78-f6afa871b901', '80748924-d735-42de-a3c8-e6bc810dbb9a', '54f742b5-867d-4156-93ee-d8a3df930021', '8c6e3f0c-149a-42d7-8e26-4367379d6660'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:38 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 Jul 27 13:29:38 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:38 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:38 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-944a4105-1c19-4b97-aef3-fdc357108ba5-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-944a4105-1c19-4b97-aef3-fdc357108ba5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:38 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 1073741824" returned: 0 in 0.630s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-quobyte-944a4105-1c19-4b97-aef3-fdc357108ba5" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-944a4105-1c19-4b97-aef3-fdc357108ba5" acquired by "delete_volume" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c952f503-bf3a-4520-9675-0a2fe27c5006]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:38 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 Jul 27 13:29:38 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:38 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.291s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486" returned: 0 in 0.468s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Deleted volume successfully. Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-33d21a78-4589-4469-8168-bd9f5036522f tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-7e944202-aca7-4bce-a7b2-48b0a316bd93-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:38 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486 Jul 27 13:29:38 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 Jul 27 13:29:38 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.888s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1316044300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5ef896-27b2-4658-bffa-2f4adeafc74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a60a46abcf429a9086b75bca64306a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:35Z,use_quota=True,user_id='e0269b6402084a8da2243952f114ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Creating volume dc5ef896-27b2-4658-bffa-2f4adeafc74c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52711e18-2ab1-4ebd-a452-9e96a4d68829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62867318-2583-415b-a624-b13849d0ac04', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:38 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c 1073741824 Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f06111-f51d-4ba0-a3f5-116bf174478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:38 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:38 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume volume-62867318-2583-415b-a624-b13849d0ac04 (62867318-2583-415b-a624-b13849d0ac04): created successfully Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f06111-f51d-4ba0-a3f5-116bf174478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:38 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (6a963baf-dadc-4b37-8eb1-d4eca5082769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:38 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-56966410-200c-4ec0-89b9-cc7e34848486" returned: 0 in 0.316s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6d8c52f5-5cb1-4062-9d84-172254bee3b0 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created volume successfully. Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Lock "cinder-quobyte-56966410-200c-4ec0-89b9-cc7e34848486" released by "delete_volume" :: held 0.844s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:39 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5" returned: 0 in 0.438s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Created reservations ['4a9f90e0-717d-426e-9294-c77342af8756', '02e0dc90-78cf-48ea-809f-a018c53ad54b', 'e2fdbded-29e1-4c40-aa9b-d2933fd1e21b', 'c57e3174-cfa1-4490-b8d3-0891c8fda694'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:39 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5 Jul 27 13:29:39 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Acquiring lock "cinder-95df1114-7a65-495f-971b-e8c003315a83-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "cinder-95df1114-7a65-495f-971b-e8c003315a83-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:39 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Acquiring lock "cinder-quobyte-95df1114-7a65-495f-971b-e8c003315a83" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "cinder-quobyte-95df1114-7a65-495f-971b-e8c003315a83" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8d728b-649a-4339-9ea4-74e1b3ca3ac4]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-944a4105-1c19-4b97-aef3-fdc357108ba5" returned: 0 in 0.320s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-944a4105-1c19-4b97-aef3-fdc357108ba5" released by "delete_volume" :: held 0.810s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Created reservations ['764bfb8e-e794-4137-8199-3fef0711f001', '5a0720c8-f90b-4ab1-84f4-4909ae54faad', '54acd8ee-27ce-4ebd-b8e1-d0438bbb0de7', 'c0c2e318-75e3-403a-846b-049a5603bb2e'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:39 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c 1073741824" returned: 0 in 0.570s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 Jul 27 13:29:39 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c Jul 27 13:29:39 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Deleted volume successfully. Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-464dc1dc-ca22-4b9a-a8b1-9ca2079ffc7a tempest-VolumeImageDependencyTests-1079731453 None] Lock "cinder-56966410-200c-4ec0-89b9-cc7e34848486-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:39 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:39 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-1b2f9e4d-66b0-4466-a321-6c73dd214c43-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-1b2f9e4d-66b0-4466-a321-6c73dd214c43-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "cinder-quobyte-1b2f9e4d-66b0-4466-a321-6c73dd214c43" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-1b2f9e4d-66b0-4466-a321-6c73dd214c43" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b708ab-57b7-459e-8adb-83759b0eba8e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83" returned: 0 in 0.527s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c" returned: 0 in 0.396s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:39 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475be300-f74b-461c-92ed-c55bc345b02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:39 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83 Jul 27 13:29:39 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06edcb4-6235-4d84-8183-2f66abbf3868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.338s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Deleted volume successfully. Jul 27 13:29:39 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 Jul 27 13:29:39 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:39 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Volume volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c (dc5ef896-27b2-4658-bffa-2f4adeafc74c): created successfully Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06edcb4-6235-4d84-8183-2f66abbf3868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Flow 'volume_create_manager' (438f83ac-d3c1-4cb1-b396-ea5b7dd0b418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-704f5323-6c22-484d-9248-ed7089a35be1 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created volume successfully. Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-78061805-0a60-436f-b9d9-bc4ea1a785e9 tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-944a4105-1c19-4b97-aef3-fdc357108ba5-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:40 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-95df1114-7a65-495f-971b-e8c003315a83" returned: 0 in 0.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "cinder-quobyte-95df1114-7a65-495f-971b-e8c003315a83" released by "delete_volume" :: held 0.877s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:40 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:40 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43 Jul 27 13:29:40 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Created reservations ['8984ac32-173d-44f6-90d6-1030641488e6', '00574dfa-bdda-4795-93be-9dc5af13b649', '11db6282-ca1d-440e-9276-4450a335db58', 'e43c651b-30c9-4906-bbc5-0b7407b01fb5'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:40 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:40 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:40 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-1b2f9e4d-66b0-4466-a321-6c73dd214c43" returned: 0 in 0.285s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-dc5ef896-27b2-4658-bffa-2f4adeafc74c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-quobyte-1b2f9e4d-66b0-4466-a321-6c73dd214c43" released by "delete_volume" :: held 0.764s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-dc5ef896-27b2-4658-bffa-2f4adeafc74c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-dc5ef896-27b2-4658-bffa-2f4adeafc74c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Created reservations ['3a638cbf-a3e7-4595-80d8-c9ffc15b9608', 'd4786c2e-c7d9-42c3-9cd2-ce8c5f8ff09f', '37e71867-897f-4a54-b3c2-5d239e195a9e', '8df46380-cf08-4001-9745-74646b70d2a1'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-dc5ef896-27b2-4658-bffa-2f4adeafc74c" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:40 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.334s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1fa87-1aea-443b-8504-d3c51dac039b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Deleted volume successfully. Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2c849b0d-e974-43aa-9c8a-1d690227d454 tempest-VolumeAndVolumeTypeFromImageTest-837765191 None] Lock "cinder-95df1114-7a65-495f-971b-e8c003315a83-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:40 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:40 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:40 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c Jul 27 13:29:40 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:41 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.373s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Deleted volume successfully. Jul 27 13:29:41 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-c1dbe629-396d-41fd-8efb-3ebcefe0a8ef tempest-CreateVolumesFromImageTest-2134204736 None] Lock "cinder-1b2f9e4d-66b0-4466-a321-6c73dd214c43-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c" returned: 0 in 0.517s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:41 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c Jul 27 13:29:41 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:41 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dc5ef896-27b2-4658-bffa-2f4adeafc74c" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-dc5ef896-27b2-4658-bffa-2f4adeafc74c" released by "delete_volume" :: held 0.882s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['f4b4d30e-f174-437d-8192-f88d2b53eebf', '11d7c3f3-cf1f-49b3-bd40-056bbcb7f91c', 'ade1f356-e3ea-4387-a00a-9fa629dcd536', '3cf64439-6569-4fe7-bc3a-d86ff333af7c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:41 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:41 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:42 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.359s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:42 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleted volume successfully. Jul 27 13:29:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b5066254-0175-4900-b08b-a2acd6c981ae tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-dc5ef896-27b2-4658-bffa-2f4adeafc74c-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-62867318-2583-415b-a624-b13849d0ac04-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-62867318-2583-415b-a624-b13849d0ac04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-62867318-2583-415b-a624-b13849d0ac04" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-62867318-2583-415b-a624-b13849d0ac04" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864716f-4e2b-44d1-919e-a3f81a99fb80]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:43 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 Jul 27 13:29:43 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:43 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04" returned: 0 in 0.465s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:43 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04 Jul 27 13:29:43 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:43 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-62867318-2583-415b-a624-b13849d0ac04" returned: 0 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-62867318-2583-415b-a624-b13849d0ac04" released by "delete_volume" :: held 0.890s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:43 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['d79c0d7a-d341-425c-8e73-a816645f703e', '9bd415cb-12fb-41c8-a3b2-8ee6895f7fcc', '232fdf52-2d25-47d0-ae19-6818e1cfc57a', '878fa037-8711-45bd-8f61-7ac0903e3f07'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:44 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:44 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:44 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.260s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleted volume successfully. Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-407c8a4e-ce41-46f6-8c1b-9273f1f14dbe tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-62867318-2583-415b-a624-b13849d0ac04-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-14818b7e-5b58-4b54-b606-ea3afb14a6e0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-14818b7e-5b58-4b54-b606-ea3afb14a6e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-14818b7e-5b58-4b54-b606-ea3afb14a6e0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-14818b7e-5b58-4b54-b606-ea3afb14a6e0" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca79964-f97a-4fdd-af59-816711223018]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:44 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 Jul 27 13:29:44 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:45 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0" returned: 0 in 0.535s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:45 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0 Jul 27 13:29:45 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:45 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-14818b7e-5b58-4b54-b606-ea3afb14a6e0" returned: 0 in 0.338s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-14818b7e-5b58-4b54-b606-ea3afb14a6e0" released by "delete_volume" :: held 0.928s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['0da4ee5a-a460-4f8c-aa63-f3219ef60ef1', '39aea6aa-6a56-494a-b455-4c463ffa791b', 'f5018e84-d13a-40c5-ac9d-ac2c957dd6c7', '06c0a277-2e54-40b7-9a8a-0bb9ad973810'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:45 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:45 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Flow 'volume_create_manager' (7ad75691-34eb-42d1-bd20-960d276d9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb61e376-f7f5-4375-b8d3-7d695a1b8165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb61e376-f7f5-4375-b8d3-7d695a1b8165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-88591417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eb5bab-2d78-46c8-b684-991b41cfe16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9b6c03744a404e817cb03dee12d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:46Z,use_quota=True,user_id='270c4267c9ea4b63bb046e0c4ae8a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63564db5-b33e-4f0c-bed1-4b2e5fa298b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63564db5-b33e-4f0c-bed1-4b2e5fa298b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfae438-b9ff-4975-af18-84f520224f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfae438-b9ff-4975-af18-84f520224f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eb5bab-2d78-46c8-b684-991b41cfe16c', 'volume_name': 'volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9603275-4343-40b9-bb21-2cc887b5bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9603275-4343-40b9-bb21-2cc887b5bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0625cdc8-caa4-4f23-9f59-a833152e5209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:45 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Volume d8eb5bab-2d78-46c8-b684-991b41cfe16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c', 'volume_size': 1} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-88591417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eb5bab-2d78-46c8-b684-991b41cfe16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9b6c03744a404e817cb03dee12d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:46Z,use_quota=True,user_id='270c4267c9ea4b63bb046e0c4ae8a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Creating volume d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:45 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-041410e1-60c5-4f0c-a76a-b67460d8fff0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:45 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c 1073741824 Jul 27 13:29:45 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-041410e1-60c5-4f0c-a76a-b67460d8fff0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-041410e1-60c5-4f0c-a76a-b67460d8fff0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:45 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.343s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleted volume successfully. Jul 27 13:29:45 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-041410e1-60c5-4f0c-a76a-b67460d8fff0" acquired by "delete_volume" :: waited 0.032s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[127dd4bf-5ed7-4940-8f2b-7b953112816b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bc35da66-ce42-42f5-978e-ae556632ad7b tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-14818b7e-5b58-4b54-b606-ea3afb14a6e0-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:46 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 Jul 27 13:29:46 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:46 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c 1073741824" returned: 0 in 0.556s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:46 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0" returned: 0 in 0.434s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:46 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0 Jul 27 13:29:46 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:46 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:29:46 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:46 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-041410e1-60c5-4f0c-a76a-b67460d8fff0" returned: 0 in 0.327s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-041410e1-60c5-4f0c-a76a-b67460d8fff0" released by "delete_volume" :: held 0.813s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:46 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0625cdc8-caa4-4f23-9f59-a833152e5209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ad18f8-4acb-4e44-8677-9e191b41c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:46 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Volume volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c (d8eb5bab-2d78-46c8-b684-991b41cfe16c): created successfully Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ad18f8-4acb-4e44-8677-9e191b41c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Flow 'volume_create_manager' (7ad75691-34eb-42d1-bd20-960d276d9af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-015ab0b4-4769-4f22-8f3f-82ea2ffee630 tempest-VolumeDependencyTests-179146048 None] Created volume successfully. Jul 27 13:29:46 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['383f7bb6-816c-4346-bc1c-04d88eac3b53', '888e3de8-4372-49d7-983e-3cba8a7844b5', '707a3976-7652-415a-8780-3a0a8f5a3a49', 'f9c316a8-600e-4b12-9b33-0044f9d00fcb'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:47 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:47 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-5211536f-49b8-45cb-902b-5b03f737ab1f-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-5211536f-49b8-45cb-902b-5b03f737ab1f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-5211536f-49b8-45cb-902b-5b03f737ab1f" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-5211536f-49b8-45cb-902b-5b03f737ab1f" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:47 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.375s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e7772-7a47-4198-b465-7c8de03113dd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleted volume successfully. Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fd9b829d-f03e-4b99-86b1-fd366cb8ca61 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-041410e1-60c5-4f0c-a76a-b67460d8fff0-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (fbcf26ee-77d6-4b65-8189-f32ddfa03844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72062a0-cded-4af8-8788-f7b182216a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72062a0-cded-4af8-8788-f7b182216a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1135756559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52b672-1a2c-4105-bdd8-0cbab3c979f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:47Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f376cf-fb92-4559-82ca-3105684d28c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f376cf-fb92-4559-82ca-3105684d28c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c95ce8-7459-48d9-a3f1-35d833d7f2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c95ce8-7459-48d9-a3f1-35d833d7f2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed52b672-1a2c-4105-bdd8-0cbab3c979f0', 'volume_name': 'volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9189b2a-62ea-4b26-8c87-ba9db4a51563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9189b2a-62ea-4b26-8c87-ba9db4a51563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71282ca-7d25-4756-a30f-4782bbafb3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:47 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume ed52b672-1a2c-4105-bdd8-0cbab3c979f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0', 'volume_size': 1} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1135756559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52b672-1a2c-4105-bdd8-0cbab3c979f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:47Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Creating volume ed52b672-1a2c-4105-bdd8-0cbab3c979f0 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:47 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:47 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f Jul 27 13:29:47 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:47 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 1073741824 Jul 27 13:29:47 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:47 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f" returned: 0 in 0.452s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:47 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f Jul 27 13:29:47 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:48 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 1073741824" returned: 0 in 0.485s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:48 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 Jul 27 13:29:48 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:48 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5211536f-49b8-45cb-902b-5b03f737ab1f" returned: 0 in 0.251s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-5211536f-49b8-45cb-902b-5b03f737ab1f" released by "delete_volume" :: held 0.755s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['200ee395-01b5-44db-9b56-3f318fdb3e66', '7830d4cd-72ed-4d9b-a1f4-01f55023887b', '1ac1f840-2a64-4381-badf-3d66c239218c', '89b84d89-1a0c-4ec7-bc2b-d103987be22f'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:48 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:48 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:48 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0" returned: 0 in 0.258s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.619s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71282ca-7d25-4756-a30f-4782bbafb3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81804d5-8b1d-46ce-abaa-227990c93e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Creating offline snapshot 4ea503f4-7cd2-45a6-87ae-e4420bc5c74c of volume d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:29:48 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 (ed52b672-1a2c-4105-bdd8-0cbab3c979f0): created successfully Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81804d5-8b1d-46ce-abaa-227990c93e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (fbcf26ee-77d6-4b65-8189-f32ddfa03844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d1ff6a-d781-43d0-8c65-a3e8c9b8a716]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f1857510-0e82-4804-ba88-f3a1c1c5112f tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created volume successfully. Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-89a1be82-656a-4bce-ad8a-43e38dcd5e67-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:48 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-89a1be82-656a-4bce-ad8a-43e38dcd5e67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.283s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleted volume successfully. Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-89a1be82-656a-4bce-ad8a-43e38dcd5e67" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5e463061-8ced-4987-b56c-692bc7bd7889 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-5211536f-49b8-45cb-902b-5b03f737ab1f-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:48 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:29:48 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-89a1be82-656a-4bce-ad8a-43e38dcd5e67" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleting offline snapshot 89a1be82-656a-4bce-ad8a-43e38dcd5e67 of volume 26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] snapshot_file for this snap is: volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ae5124-6222-4196-ae64-078182331c76]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:48 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 Jul 27 13:29:48 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:48 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.478s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:48 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c 1G Jul 27 13:29:48 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:49 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67" returned: 0 in 0.436s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab736f6-13bd-411e-b443-f86d9806c295]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:49 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd Jul 27 13:29:49 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:49 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c 1G" returned: 0 in 0.481s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:49 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c Jul 27 13:29:49 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:49 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" returned: 0 in 0.424s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:49 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 Jul 27 13:29:49 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:49 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:49 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c is being set with open permissions: ugo+rw Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:49 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c Jul 27 13:29:49 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:49 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:49 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67 Jul 27 13:29:49 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:50 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (eb3d7ceb-ac9a-4cd1-90ee-c2d6a67a4c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72328a3-3513-475a-a9c7-c8d713e066c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" returned: 0 in 0.313s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72328a3-3513-475a-a9c7-c8d713e066c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362132948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bccebc-774b-4ecf-8ef3-10963365f01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:50Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0da66bf-8045-446d-a13e-df19e24e355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0da66bf-8045-446d-a13e-df19e24e355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abac563e-cb0b-45c8-ab52-7e3643ad11f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abac563e-cb0b-45c8-ab52-7e3643ad11f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51bccebc-774b-4ecf-8ef3-10963365f01b', 'volume_name': 'volume-51bccebc-774b-4ecf-8ef3-10963365f01b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fc83c8-3569-4d87-b94c-cec349387fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fc83c8-3569-4d87-b94c-cec349387fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486252b5-1b7c-4119-b08d-da4db6a26a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume 51bccebc-774b-4ecf-8ef3-10963365f01b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51bccebc-774b-4ecf-8ef3-10963365f01b', 'volume_size': 1} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:50 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info Jul 27 13:29:50 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:50 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd.89a1be82-656a-4bce-ad8a-43e38dcd5e67" returned: 0 in 0.303s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-89a1be82-656a-4bce-ad8a-43e38dcd5e67" released by "_delete_snapshot" :: held 1.707s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" released by "delete_snapshot" :: held 1.747s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (169d3653-df4c-429c-b26c-08b9a3154e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6b7317-7a8f-43a6-b62d-82a2f863501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info" returned: 0 in 0.338s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:50 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info is being set with open permissions: ugo+rw Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6b7317-7a8f-43a6-b62d-82a2f863501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205294461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d834b17-0f58-40c2-b814-5a6dc3e6de4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:50Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376ae007-d83a-446f-882f-f13b8cd18d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376ae007-d83a-446f-882f-f13b8cd18d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b42a28-ef2b-47ec-a611-0bd9009517f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b42a28-ef2b-47ec-a611-0bd9009517f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d834b17-0f58-40c2-b814-5a6dc3e6de4d', 'volume_name': 'volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da7000f-c1ca-455e-a53a-7539494db1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da7000f-c1ca-455e-a53a-7539494db1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b4305c-a84d-4375-a59f-5f43fafa3331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:50 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume 8d834b17-0f58-40c2-b814-5a6dc3e6de4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d', 'volume_size': 1} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['a986cb5c-176b-446e-8ecc-d8c9d9b99285', '8de1adff-1d86-4283-9612-76065a41ab1b', 'be47ea8f-7455-4f11-b807-faec4c2bd6dc', '6ece8aa4-bde9-4141-aef7-37cec13963b1'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Delete snapshot completed successfully. Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-eecd7a51-66ab-4f58-9634-289e1a125632 tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-89a1be82-656a-4bce-ad8a-43e38dcd5e67-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:50 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.info" returned: 0 in 0.332s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362132948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bccebc-774b-4ecf-8ef3-10963365f01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:50Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Creating volume 51bccebc-774b-4ecf-8ef3-10963365f01b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:50 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:50 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b 1073741824 Jul 27 13:29:50 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0ccce949-813c-498d-8bab-a5b6a2bc74e3 tempest-VolumeDependencyTests-179146048 None] Create snapshot completed successfully Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:50 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (e91fce89-99cf-4293-9aeb-82e885adf741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41ae856-be1c-4ca3-a393-3c9fe85e9509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41ae856-be1c-4ca3-a393-3c9fe85e9509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381713096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20c79d5-167e-4e5d-bacc-9e38091acc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:51Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2971aaa7-2d8b-4671-928c-86de7ca37629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2971aaa7-2d8b-4671-928c-86de7ca37629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de63d06-dbc2-4411-822c-a6fbfc15ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de63d06-dbc2-4411-822c-a6fbfc15ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20c79d5-167e-4e5d-bacc-9e38091acc9d', 'volume_name': 'volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea09ba59-5071-4543-8229-078aac47a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea09ba59-5071-4543-8229-078aac47a205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e27d3c3-ec5e-4886-904b-fb275564736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume f20c79d5-167e-4e5d-bacc-9e38091acc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d', 'volume_size': 1} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "cinder-quobyte-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" acquired by "delete_volume" :: waited 0.037s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc9b86-1f4f-46c7-a86d-2ffd04d29336]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:51 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd Jul 27 13:29:51 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (0c596488-bbcc-4819-91d5-6b355abcadf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0085ad9e-5765-4576-ae6e-efc3bc140e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b 1073741824" returned: 0 in 0.737s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0085ad9e-5765-4576-ae6e-efc3bc140e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498767165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec3aaff-9e19-46a0-866d-69f0333c2132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:51Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd9cc1a-6d50-4484-8e76-60a0274d7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd9cc1a-6d50-4484-8e76-60a0274d7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edd1527-42ac-448c-af55-2db514cda933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edd1527-42ac-448c-af55-2db514cda933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec3aaff-9e19-46a0-866d-69f0333c2132', 'volume_name': 'volume-dec3aaff-9e19-46a0-866d-69f0333c2132', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affb0559-8073-4f9d-aff1-e6352b5f57df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affb0559-8073-4f9d-aff1-e6352b5f57df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812752f9-51ac-46d6-9668-4b1cc9d76d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:51 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume dec3aaff-9e19-46a0-866d-69f0333c2132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec3aaff-9e19-46a0-866d-69f0333c2132', 'volume_size': 1} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:51 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b Jul 27 13:29:51 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:51 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" returned: 0 in 0.616s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:52 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd Jul 27 13:29:52 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:52 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b" returned: 0 in 0.356s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205294461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d834b17-0f58-40c2-b814-5a6dc3e6de4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:50Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Creating volume 8d834b17-0f58-40c2-b814-5a6dc3e6de4d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:52 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486252b5-1b7c-4119-b08d-da4db6a26a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51bccebc-774b-4ecf-8ef3-10963365f01b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d 1073741824 Jul 27 13:29:52 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9766e865-615f-450f-8123-7c2273d9d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume volume-51bccebc-774b-4ecf-8ef3-10963365f01b (51bccebc-774b-4ecf-8ef3-10963365f01b): created successfully Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9766e865-615f-450f-8123-7c2273d9d187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (eb3d7ceb-ac9a-4cd1-90ee-c2d6a67a4c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5b78acf4-a4d3-41cc-9526-61b5aa6da032 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created volume successfully. Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:52 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (ec485826-d38b-41f7-a5fa-e238d7822416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e38b109-cf76-4cf2-9447-a4a8aa6ce784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" returned: 0 in 0.395s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e38b109-cf76-4cf2-9447-a4a8aa6ce784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579528540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03875a1-2bd2-42fe-bb79-42db29bf4981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:52Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64eed0c1-ae96-4c3b-8268-fe9f41e2b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64eed0c1-ae96-4c3b-8268-fe9f41e2b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c82504-c56b-4a5f-a71f-231d83214c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c82504-c56b-4a5f-a71f-231d83214c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03875a1-2bd2-42fe-bb79-42db29bf4981', 'volume_name': 'volume-a03875a1-2bd2-42fe-bb79-42db29bf4981', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5473b7c-bc72-42d1-a082-4c16a9278bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5473b7c-bc72-42d1-a082-4c16a9278bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbeae3f8-c761-41a5-bd30-4a94234813aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume a03875a1-2bd2-42fe-bb79-42db29bf4981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03875a1-2bd2-42fe-bb79-42db29bf4981', 'volume_size': 1} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-quobyte-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd" released by "delete_volume" :: held 1.179s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Flow 'volume_create_manager' (6e3babd2-a205-43b2-a588-bef7d2ac6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f96122b-5be9-4a65-8ad6-a6cf710ab236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f96122b-5be9-4a65-8ad6-a6cf710ab236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1691388738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b379976-7edf-4754-a3a4-719d48707f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9b6c03744a404e817cb03dee12d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ea503f4-7cd2-45a6-87ae-e4420bc5c74c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:52Z,use_quota=True,user_id='270c4267c9ea4b63bb046e0c4ae8a597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67388590-1261-467a-8e8f-03326597e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67388590-1261-467a-8e8f-03326597e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383665e-f318-436c-ad11-2acbcd2422f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383665e-f318-436c-ad11-2acbcd2422f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b379976-7edf-4754-a3a4-719d48707f11', 'volume_name': 'volume-3b379976-7edf-4754-a3a4-719d48707f11', 'volume_size': 1, 'snapshot_id': '4ea503f4-7cd2-45a6-87ae-e4420bc5c74c'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476326b4-24b2-433d-82da-0255f82f2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476326b4-24b2-433d-82da-0255f82f2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb0eff1-9afb-4f68-a085-e735abb1afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Volume 3b379976-7edf-4754-a3a4-719d48707f11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b379976-7edf-4754-a3a4-719d48707f11', 'volume_size': 1, 'snapshot_id': '4ea503f4-7cd2-45a6-87ae-e4420bc5c74c'} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Created reservations ['30b1798a-7404-4763-8c02-f0c6cef95a29', '303d19f1-7a7d-4cf0-ac57-f934b379f4e9', '073721dc-d341-47c4-a279-13323427a56d', '733e5dd8-bf46-4fde-9d4a-401dc3a10518'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:52 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d 1073741824" returned: 0 in 0.650s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:52 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:52 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:52 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d Jul 27 13:29:52 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:53 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Deleted volume successfully. Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-b3479da3-11a6-46a2-b731-5ee98c96d30e tempest-CreateVolumesFromSnapshotTest-541055521 None] Lock "cinder-26b058b1-b1b9-4aa6-8660-c17de5ed9bfd-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:53 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d" returned: 0 in 0.346s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381713096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20c79d5-167e-4e5d-bacc-9e38091acc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:51Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Creating volume f20c79d5-167e-4e5d-bacc-9e38091acc9d {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:53 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b4305c-a84d-4375-a59f-5f43fafa3331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cb84bc-f114-42fd-a5c6-46162ecc561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:53 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d 1073741824 Jul 27 13:29:53 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d (8d834b17-0f58-40c2-b814-5a6dc3e6de4d): created successfully Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cb84bc-f114-42fd-a5c6-46162ecc561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (169d3653-df4c-429c-b26c-08b9a3154e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f3c8a8d0-c90a-4bd9-9869-8ccae82bef69 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created volume successfully. Jul 27 13:29:53 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d 1073741824" returned: 0 in 0.528s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:53 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d Jul 27 13:29:53 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:54 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d" returned: 0 in 0.319s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.386s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498767165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec3aaff-9e19-46a0-866d-69f0333c2132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:51Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Creating volume dec3aaff-9e19-46a0-866d-69f0333c2132 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:54 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e27d3c3-ec5e-4886-904b-fb275564736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e29ba-ea2d-4dfe-bbea-d3ee247b4d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:54 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 1073741824 Jul 27 13:29:54 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:54 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d (f20c79d5-167e-4e5d-bacc-9e38091acc9d): created successfully Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e29ba-ea2d-4dfe-bbea-d3ee247b4d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (e91fce89-99cf-4293-9aeb-82e885adf741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-134597a9-e297-483a-ac85-0c3b2f02da4e tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created volume successfully. Jul 27 13:29:54 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 1073741824" returned: 0 in 0.578s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:54 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 Jul 27 13:29:54 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:55 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132" returned: 0 in 0.330s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.572s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579528540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03875a1-2bd2-42fe-bb79-42db29bf4981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542dce0e9eaf4aaeb7af2a36a2a88723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:29:52Z,use_quota=True,user_id='56023e79d22a4250af312d93990b6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Creating volume a03875a1-2bd2-42fe-bb79-42db29bf4981 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:55 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:55 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 1073741824 Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812752f9-51ac-46d6-9668-4b1cc9d76d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec3aaff-9e19-46a0-866d-69f0333c2132', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:55 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5854530e-b721-44c8-b376-6c26efa7aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume volume-dec3aaff-9e19-46a0-866d-69f0333c2132 (dec3aaff-9e19-46a0-866d-69f0333c2132): created successfully Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5854530e-b721-44c8-b376-6c26efa7aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (0c596488-bbcc-4819-91d5-6b355abcadf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6b33b394-55cc-4c95-bfb8-2aad2cb04509 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created volume successfully. Jul 27 13:29:55 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 1073741824" returned: 0 in 0.524s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:55 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 Jul 27 13:29:55 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:55 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.286s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-quobyte-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c-3b379976-7edf-4754-a3a4-719d48707f11" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbeae3f8-c761-41a5-bd30-4a94234813aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03875a1-2bd2-42fe-bb79-42db29bf4981', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15defe6-8de9-4eb7-9438-7bb5770eb0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c-3b379976-7edf-4754-a3a4-719d48707f11" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Creating volume 3b379976-7edf-4754-a3a4-719d48707f11 from snapshot 4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-quobyte-3b379976-7edf-4754-a3a4-719d48707f11" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:55 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Volume volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 (a03875a1-2bd2-42fe-bb79-42db29bf4981): created successfully Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15defe6-8de9-4eb7-9438-7bb5770eb0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Flow 'volume_create_manager' (ec485826-d38b-41f7-a5fa-e238d7822416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-3b379976-7edf-4754-a3a4-719d48707f11" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] snapshot: 4ea503f4-7cd2-45a6-87ae-e4420bc5c74c, volume: 3b379976-7edf-4754-a3a4-719d48707f11, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-26c9c51b-dd60-4ce1-9a57-af6e5b606b87 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created volume successfully. Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[70510c05-ebc3-4b8f-a7fc-0b05e8d07857]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:56 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c Jul 27 13:29:56 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:56 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" returned: 0 in 0.484s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f3149a-766c-46ec-bd8e-4b8c9e587283]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-a03875a1-2bd2-42fe-bb79-42db29bf4981-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-a03875a1-2bd2-42fe-bb79-42db29bf4981-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-quobyte-a03875a1-2bd2-42fe-bb79-42db29bf4981" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-a03875a1-2bd2-42fe-bb79-42db29bf4981" acquired by "delete_volume" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:56 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:29:56 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f48eb-1768-4951-b8ea-dfa756146ed7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:56 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 Jul 27 13:29:56 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-93c4afc2-9899-4270-8a55-671178837197 tempest-ProjectAdminTests-1094256863 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88202) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 27 13:29:57 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.472s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:57 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 Jul 27 13:29:57 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:57 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981" returned: 0 in 0.436s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:57 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981 Jul 27 13:29:57 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:57 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a03875a1-2bd2-42fe-bb79-42db29bf4981" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-a03875a1-2bd2-42fe-bb79-42db29bf4981" released by "delete_volume" :: held 0.870s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created reservations ['aea3ee56-d50d-46c0-b7ea-44d7a6b38f6c', '1813365f-6f6a-4e89-8a1b-d12cc2b16197', 'fbcbdcac-2a17-494a-b54a-b4cca94233b2', 'd4aa6ea9-a546-4ab4-a220-bbfa887c7b35'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:29:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:58 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:29:58 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-dec3aaff-9e19-46a0-866d-69f0333c2132-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-dec3aaff-9e19-46a0-866d-69f0333c2132-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-quobyte-dec3aaff-9e19-46a0-866d-69f0333c2132" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-dec3aaff-9e19-46a0-866d-69f0333c2132" acquired by "delete_volume" :: waited 0.052s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[05087cba-e7a0-4ce7-849f-abe88ac29ef1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:58 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.901s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:29:58 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Deleted volume successfully. Jul 27 13:29:58 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 Jul 27 13:29:58 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:29:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-79b1d8ed-82ba-451b-8a3f-ab7ebf93e90d tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-a03875a1-2bd2-42fe-bb79-42db29bf4981-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:29:59 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 27 13:29:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132" returned: 0 in 1.120s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:29:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:29:59 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132 Jul 27 13:29:59 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:00 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-dec3aaff-9e19-46a0-866d-69f0333c2132" returned: 0 in 1.202s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-dec3aaff-9e19-46a0-866d-69f0333c2132" released by "delete_volume" :: held 2.451s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created reservations ['8bdfce18-33ed-4ca2-906e-01ba5a9213ee', '6cf3cf94-a15b-4270-b2b9-1d0124be5dda', 'f96fcaff-6d1b-45c5-b455-1194734d0318', '5de48f9b-d05d-464d-9ba9-f110f5756541'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:01 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:01 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:01 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.585s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:01 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Deleted volume successfully. Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-941dd24e-3c83-42ec-9ca6-663612043714 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-dec3aaff-9e19-46a0-866d-69f0333c2132-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-f20c79d5-167e-4e5d-bacc-9e38091acc9d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-f20c79d5-167e-4e5d-bacc-9e38091acc9d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-quobyte-f20c79d5-167e-4e5d-bacc-9e38091acc9d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-f20c79d5-167e-4e5d-bacc-9e38091acc9d" acquired by "delete_volume" :: waited 0.043s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d5b2a-eac9-44d3-95e2-c174dc1f4842]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:02 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d Jul 27 13:30:02 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:03 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11" returned: 0 in 6.031s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b761a2e-34cb-400e-9b84-326266251014]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:03 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:30:03 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:03 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d" returned: 0 in 0.703s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:03 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d Jul 27 13:30:03 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:03 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f20c79d5-167e-4e5d-bacc-9e38091acc9d" returned: 0 in 0.311s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-f20c79d5-167e-4e5d-bacc-9e38091acc9d" released by "delete_volume" :: held 1.105s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created reservations ['7c27e090-abdc-4658-bea8-01411f606c29', '088f6c42-bf15-45f5-83db-64dd94ec78d5', 'cf119ad9-34e6-4799-8066-c5279a0b2dc4', '950b0a69-ed12-4d9e-bfae-5f4e834341da'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:03 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:03 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:03 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.779s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:30:03 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Converted 1024.00 MB image at 169.75 MB/s Jul 27 13:30:03 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 is being set with open permissions: ugo+rw Jul 27 13:30:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:03 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 Jul 27 13:30:03 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:04 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Deleted volume successfully. Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34078600-98cc-4e13-9d4f-20a32bc2c635 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-f20c79d5-167e-4e5d-bacc-9e38091acc9d-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:04 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11" returned: 0 in 0.293s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-3b379976-7edf-4754-a3a4-719d48707f11" released by "_copy_volume_from_snapshot" :: held 8.214s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c-3b379976-7edf-4754-a3a4-719d48707f11" released by "_create_volume_from_snapshot" :: held 8.270s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.306s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb0eff1-9afb-4f68-a085-e735abb1afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b379976-7edf-4754-a3a4-719d48707f11', 'volume_size': 1, 'snapshot_id': '4ea503f4-7cd2-45a6-87ae-e4420bc5c74c'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2ceb63-dbed-4bf8-88f5-64ed12af45b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Volume volume-3b379976-7edf-4754-a3a4-719d48707f11 (3b379976-7edf-4754-a3a4-719d48707f11): created successfully Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2ceb63-dbed-4bf8-88f5-64ed12af45b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Flow 'volume_create_manager' (6e3babd2-a205-43b2-a588-bef7d2ac6b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-044363a3-055b-42dd-9e99-652c49224511 tempest-VolumeDependencyTests-179146048 None] Created volume successfully. Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-quobyte-d8eb5bab-2d78-46c8-b684-991b41cfe16c" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-d8eb5bab-2d78-46c8-b684-991b41cfe16c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-quobyte-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Deleting offline snapshot 4ea503f4-7cd2-45a6-87ae-e4420bc5c74c of volume d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] snapshot_file for this snap is: volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e0539-bc1b-453b-8ad0-84821a1cf584]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-8d834b17-0f58-40c2-b814-5a6dc3e6de4d-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-8d834b17-0f58-40c2-b814-5a6dc3e6de4d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-quobyte-8d834b17-0f58-40c2-b814-5a6dc3e6de4d" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-8d834b17-0f58-40c2-b814-5a6dc3e6de4d" acquired by "delete_volume" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:05 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c Jul 27 13:30:05 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1dd713-11c8-4499-83e8-b44e319fec17]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d Jul 27 13:30:05 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (786cf016-6ff0-4e42-803a-707cf54e5376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020f8086-ca0d-4ec7-ac6a-96408fe0174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020f8086-ca0d-4ec7-ac6a-96408fe0174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1283529185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0579c80-c0d1-487e-bfa9-c181a3b981cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:05Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6515a5aa-99f9-4787-92b3-519ad9b683e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6515a5aa-99f9-4787-92b3-519ad9b683e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcb9a2c-5d02-474b-b0ba-2a5a4b63f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcb9a2c-5d02-474b-b0ba-2a5a4b63f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0579c80-c0d1-487e-bfa9-c181a3b981cb', 'volume_name': 'volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd21867b-2dfb-496b-97ce-c921aa29da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd21867b-2dfb-496b-97ce-c921aa29da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db332e2-48fd-486c-8b89-d873df0efc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Volume d0579c80-c0d1-487e-bfa9-c181a3b981cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb', 'volume_size': 1} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1283529185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0579c80-c0d1-487e-bfa9-c181a3b981cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:05Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Creating volume d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:05 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:05 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb 1073741824 Jul 27 13:30:05 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (0c553c93-05df-4676-bd35-ffc8c9012152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca25c83-fbb9-43e9-8224-24ee47f43241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" returned: 0 in 0.490s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca25c83-fbb9-43e9-8224-24ee47f43241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028663689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89db64d-3aa7-4f4b-ba73-61746880fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:05Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b280fa-61af-4882-a4bb-f01b546189c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b280fa-61af-4882-a4bb-f01b546189c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629e5d21-e9f8-40ad-827a-16dc27fed417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629e5d21-e9f8-40ad-827a-16dc27fed417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89db64d-3aa7-4f4b-ba73-61746880fe4b', 'volume_name': 'volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8efb8c-2161-4434-8a9f-9cf2217f7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8efb8c-2161-4434-8a9f-9cf2217f7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acfa3de-91ec-44b7-baae-63f0a08faa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:05 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Volume f89db64d-3aa7-4f4b-ba73-61746880fe4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b', 'volume_size': 1} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59e064-cee8-49bd-94fa-320ee15f0c69]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d" returned: 0 in 0.411s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d Jul 27 13:30:05 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:05 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:30:05 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:05 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8d834b17-0f58-40c2-b814-5a6dc3e6de4d" returned: 0 in 0.267s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-8d834b17-0f58-40c2-b814-5a6dc3e6de4d" released by "delete_volume" :: held 0.724s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:05 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb 1073741824" returned: 0 in 0.459s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.403s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:05 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb Jul 27 13:30:05 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:05 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created reservations ['6f6847b6-e2b1-42eb-9263-858b42622ad2', '48d47f25-955c-4fdb-bd46-970b0c089e99', 'e2d7b326-9704-4bba-957f-f1bbbed4e667', 'b191609e-1084-4b86-9646-2ea5ab9f3c35'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:05 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c Jul 27 13:30:05 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:06 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:06 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb" returned: 0 in 0.303s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028663689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89db64d-3aa7-4f4b-ba73-61746880fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:05Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Creating volume f89db64d-3aa7-4f4b-ba73-61746880fe4b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:06 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-51bccebc-774b-4ecf-8ef3-10963365f01b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db332e2-48fd-486c-8b89-d873df0efc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d62cda9-50ed-4193-a9c2-0153a5c43b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:06 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b 1073741824 Jul 27 13:30:06 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-51bccebc-774b-4ecf-8ef3-10963365f01b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:06 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Volume volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb (d0579c80-c0d1-487e-bfa9-c181a3b981cb): created successfully Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d62cda9-50ed-4193-a9c2-0153a5c43b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (786cf016-6ff0-4e42-803a-707cf54e5376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7f2c5452-13a4-4568-a1ef-2b2b0d43cb7d tempest-ProjectReaderTests-1981262615 None] Created volume successfully. Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-quobyte-51bccebc-774b-4ecf-8ef3-10963365f01b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-51bccebc-774b-4ecf-8ef3-10963365f01b" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b45419a-0786-4a77-ba9e-e8cc05962356]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:06 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.347s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Deleted volume successfully. Jul 27 13:30:06 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4ef4e326-6f9c-4499-8a03-20710b43ad64 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-8d834b17-0f58-40c2-b814-5a6dc3e6de4d-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" returned: 0 in 0.548s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:06 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c Jul 27 13:30:06 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b Jul 27 13:30:06 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b 1073741824" returned: 0 in 0.475s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:06 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c.4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" returned: 0 in 0.260s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c" released by "_delete_snapshot" :: held 1.850s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-d8eb5bab-2d78-46c8-b684-991b41cfe16c" released by "delete_snapshot" :: held 1.897s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:06 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b Jul 27 13:30:06 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b" returned: 0 in 0.447s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:06 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b Jul 27 13:30:06 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Created reservations ['5c4b78eb-ec2f-4a6c-9f15-b36ce043c184', 'ceba6dcd-f526-4af7-9ace-fcc542169c10', '47593ca1-9c37-445e-8f16-9c6a9272da6a', 'ce3b7721-f041-443b-b8ff-6010bc56839a'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:06 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Delete snapshot completed successfully. Jul 27 13:30:06 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-3c9879fc-1d08-4797-9073-181fd158fa93 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-4ea503f4-7cd2-45a6-87ae-e4420bc5c74c-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-d8eb5bab-2d78-46c8-b684-991b41cfe16c-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:07 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b" returned: 0 in 0.298s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-d8eb5bab-2d78-46c8-b684-991b41cfe16c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acfa3de-91ec-44b7-baae-63f0a08faa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a85d4c3-6b17-4b97-b922-ecd7c0ab3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:07 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Volume volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b (f89db64d-3aa7-4f4b-ba73-61746880fe4b): created successfully Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a85d4c3-6b17-4b97-b922-ecd7c0ab3070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (0c553c93-05df-4676-bd35-ffc8c9012152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-quobyte-d8eb5bab-2d78-46c8-b684-991b41cfe16c" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-d8eb5bab-2d78-46c8-b684-991b41cfe16c" acquired by "delete_volume" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:07 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-51bccebc-774b-4ecf-8ef3-10963365f01b" returned: 0 in 0.385s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-77633562-4c43-4e23-bcfd-f04c5987d455 tempest-ProjectReaderTests-210250389 None] Created volume successfully. Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084c9b4-a92c-43f7-a535-7bce7cddf8b7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-51bccebc-774b-4ecf-8ef3-10963365f01b" released by "delete_volume" :: held 0.896s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created reservations ['66b7cc9b-9f21-4c51-b0b5-f11934a6bf80', '80a01e5e-d775-44f4-ba46-a4052c9433de', 'ea7aebe4-45c6-4bec-ac49-ed5a2b323f5e', '4f3434f5-75fb-4306-842a-94f4c3face0d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:07 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:30:07 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:07 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:07 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-f89db64d-3aa7-4f4b-ba73-61746880fe4b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Lock "cinder-f89db64d-3aa7-4f4b-ba73-61746880fe4b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-ed52b672-1a2c-4105-bdd8-0cbab3c979f0-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Creating offline snapshot 4902c196-f125-48bd-8283-5262c243e054 of volume d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9096954e-1743-4edc-9e89-1061abb85a42]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-ed52b672-1a2c-4105-bdd8-0cbab3c979f0-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:07 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-quobyte-f89db64d-3aa7-4f4b-ba73-61746880fe4b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.482s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:07 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c Jul 27 13:30:07 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-f89db64d-3aa7-4f4b-ba73-61746880fe4b" acquired by "delete_volume" :: waited 0.049s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "cinder-quobyte-ed52b672-1a2c-4105-bdd8-0cbab3c979f0" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:07 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb Jul 27 13:30:07 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-ed52b672-1a2c-4105-bdd8-0cbab3c979f0" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52507f8-4f63-491e-8249-551b3709fbdb]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:07 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b5b85b-456a-4bc8-8d77-54b6d1d7c54a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:07 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Deleted volume successfully. Jul 27 13:30:07 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f196eaf7-a1d4-40fb-89db-c6b262ca22e5 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-51bccebc-774b-4ecf-8ef3-10963365f01b-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:08 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b Jul 27 13:30:08 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d8eb5bab-2d78-46c8-b684-991b41cfe16c" returned: 0 in 0.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 Jul 27 13:30:08 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-d8eb5bab-2d78-46c8-b684-991b41cfe16c" released by "delete_volume" :: held 0.861s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Created reservations ['daec4fc7-d50e-403a-9edf-4127d74d82c4', '2d4ad0e6-8913-404a-b072-c054f95a4d79', '64ae792f-90d7-45f7-af98-7822208d0f27', '0f59c929-f252-4832-ba0f-b3ef5eb7acfe'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:08 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb" returned: 0 in 0.494s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:08 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 1G Jul 27 13:30:08 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:08 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:08 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-3b379976-7edf-4754-a3a4-719d48707f11-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:08 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-3b379976-7edf-4754-a3a4-719d48707f11-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0" returned: 0 in 0.498s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:08 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0 Jul 27 13:30:08 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b" returned: 0 in 0.576s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:08 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b Jul 27 13:30:08 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "cinder-quobyte-3b379976-7edf-4754-a3a4-719d48707f11" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-3b379976-7edf-4754-a3a4-719d48707f11" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb1848-393c-4fd2-be1d-ac8db65fdd90]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:08 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.342s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Deleted volume successfully. Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-08741d8a-bd78-4392-8262-982a77336547 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-d8eb5bab-2d78-46c8-b684-991b41cfe16c-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:08 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 Jul 27 13:30:08 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 1G" returned: 0 in 0.540s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:08 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 Jul 27 13:30:08 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:08 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f89db64d-3aa7-4f4b-ba73-61746880fe4b" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-f89db64d-3aa7-4f4b-ba73-61746880fe4b" released by "delete_volume" :: held 1.017s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:08 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ed52b672-1a2c-4105-bdd8-0cbab3c979f0" returned: 0 in 0.436s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-quobyte-ed52b672-1a2c-4105-bdd8-0cbab3c979f0" released by "delete_volume" :: held 1.010s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Created reservations ['303c2555-8a80-4a8e-8c25-127bf9fc51bd', 'b8b5deb6-61c8-42e2-a98b-b0dd858f01d7', '0119c928-0b13-48bd-9748-9793a47bbea8', 'c40906bb-d7b9-4d3e-aab1-9c3e29476983'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Created reservations ['3c4c0196-654d-4bae-bea9-3359d615eff7', '6ad39751-3bc1-4b2e-b7ee-f3edbfdeaba9', 'bd5ab2cd-8d4f-4f30-92b9-611c8fc8705a', 'd944b78e-784b-4b81-b90d-1ce5f47b3d4c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:09 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11" returned: 0 in 0.504s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:09 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11 Jul 27 13:30:09 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 is being set with open permissions: ugo+rw Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 Jul 27 13:30:09 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Deleted volume successfully. Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-363a0e35-114f-4085-82da-fced31aa48da tempest-ProjectReaderTests-210250389 None] Lock "cinder-f89db64d-3aa7-4f4b-ba73-61746880fe4b-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:09 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.284s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:09 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3b379976-7edf-4754-a3a4-719d48707f11" returned: 0 in 0.279s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Deleted volume successfully. Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-quobyte-3b379976-7edf-4754-a3a4-719d48707f11" released by "delete_volume" :: held 0.837s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-11d8dd8b-452c-46e9-af38-c0dc7765aa77 tempest-CreateVolumesFromSourceVolumeTest-1103912592 None] Lock "cinder-ed52b672-1a2c-4105-bdd8-0cbab3c979f0-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Created reservations ['b7d23fb5-2dc2-4ff9-9aec-b072adb80dcc', '0651e22e-b2e4-4a2d-9d9d-da76a401083d', 'f2ec0fb2-697a-488f-9a5c-8c1c70758d4f', '549d8098-de01-4e8b-a95b-fcd6719bee2d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:09 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054" returned: 0 in 0.297s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info Jul 27 13:30:09 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:09 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info is being set with open permissions: ugo+rw Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:09 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info Jul 27 13:30:09 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:09 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.283s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:09 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Deleted volume successfully. Jul 27 13:30:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-2065f9e8-e87b-4761-aa02-522889085ee7 tempest-VolumeDependencyTests-179146048 None] Lock "cinder-3b379976-7edf-4754-a3a4-719d48707f11-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:10 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.info" returned: 0 in 0.335s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:10 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6fd4f03e-1667-46f2-8884-9ccc56a0cb6d tempest-ProjectReaderTests-1981262615 None] Create snapshot completed successfully Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (8f2b2a7a-3723-45b2-b8a8-60d0bc7f7ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddaa9ed-1b05-4950-919d-0a76755206b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddaa9ed-1b05-4950-919d-0a76755206b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104175716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57df8cf-48d2-470c-ab72-f468dfe77396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:10Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bb659d-6a72-4e0e-8997-8e9dbf48024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bb659d-6a72-4e0e-8997-8e9dbf48024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94b9a03-8416-4900-b83d-0a479b2fa7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94b9a03-8416-4900-b83d-0a479b2fa7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57df8cf-48d2-470c-ab72-f468dfe77396', 'volume_name': 'volume-f57df8cf-48d2-470c-ab72-f468dfe77396', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b611dd2-fb42-4027-991f-3ac7788101a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b611dd2-fb42-4027-991f-3ac7788101a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a507cd1-9513-4a95-8f29-67a1c57f4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:10 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Volume f57df8cf-48d2-470c-ab72-f468dfe77396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57df8cf-48d2-470c-ab72-f468dfe77396', 'volume_size': 1} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104175716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57df8cf-48d2-470c-ab72-f468dfe77396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:10Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Creating volume f57df8cf-48d2-470c-ab72-f468dfe77396 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:10 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:10 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 1073741824 Jul 27 13:30:10 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:11 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 1073741824" returned: 0 in 0.668s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-4902c196-f125-48bd-8283-5262c243e054-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-4902c196-f125-48bd-8283-5262c243e054-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-d0579c80-c0d1-487e-bfa9-c181a3b981cb" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:11 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 Jul 27 13:30:11 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-d0579c80-c0d1-487e-bfa9-c181a3b981cb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-4902c196-f125-48bd-8283-5262c243e054" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-4902c196-f125-48bd-8283-5262c243e054" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Deleting offline snapshot 4902c196-f125-48bd-8283-5262c243e054 of volume d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] snapshot_file for this snap is: volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4fc93f-ff65-4cc9-8d60-b1a12e56a79a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:11 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 Jul 27 13:30:11 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:11 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396" returned: 0 in 0.300s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a507cd1-9513-4a95-8f29-67a1c57f4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57df8cf-48d2-470c-ab72-f468dfe77396', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719f871f-2614-4e94-86ee-963652ae3703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:11 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Volume volume-f57df8cf-48d2-470c-ab72-f468dfe77396 (f57df8cf-48d2-470c-ab72-f468dfe77396): created successfully Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719f871f-2614-4e94-86ee-963652ae3703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (8f2b2a7a-3723-45b2-b8a8-60d0bc7f7ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-70893aa2-7272-4f33-8cc4-ec853d444384 tempest-ProjectReaderTests-210250389 None] Created volume successfully. Jul 27 13:30:11 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054" returned: 0 in 0.421s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee69e3c6-6ce8-466d-a5db-47ea0500f225]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:11 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb Jul 27 13:30:11 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:12 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:12 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 Jul 27 13:30:12 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-f57df8cf-48d2-470c-ab72-f468dfe77396-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Lock "cinder-f57df8cf-48d2-470c-ab72-f468dfe77396-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-quobyte-f57df8cf-48d2-470c-ab72-f468dfe77396" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:12 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-f57df8cf-48d2-470c-ab72-f468dfe77396" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054" returned: 0 in 0.483s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e529039-50eb-42f4-b004-1d6a749fc2ff]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:12 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054 Jul 27 13:30:12 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:12 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 Jul 27 13:30:12 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:13 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb.4902c196-f125-48bd-8283-5262c243e054" returned: 0 in 0.321s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-4902c196-f125-48bd-8283-5262c243e054" released by "_delete_snapshot" :: held 1.790s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-d0579c80-c0d1-487e-bfa9-c181a3b981cb" released by "delete_snapshot" :: held 1.816s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Created reservations ['03d54cf6-89a0-4d1b-aa16-49616dc7a975', 'f471daab-7a83-4f75-903b-2806d7d050d4', '4218484c-cd6d-4624-8178-5ab0d7cb05c4', 'ed7421de-9285-47c1-a012-7902575d98b7'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:13 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396" returned: 0 in 0.467s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:13 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396 Jul 27 13:30:13 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:13 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Delete snapshot completed successfully. Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8251df87-0781-4c13-af5a-554541f5c27e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-4902c196-f125-48bd-8283-5262c243e054-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-d0579c80-c0d1-487e-bfa9-c181a3b981cb-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-d0579c80-c0d1-487e-bfa9-c181a3b981cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-d0579c80-c0d1-487e-bfa9-c181a3b981cb" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-d0579c80-c0d1-487e-bfa9-c181a3b981cb" acquired by "delete_volume" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:13 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-f57df8cf-48d2-470c-ab72-f468dfe77396" returned: 0 in 0.403s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f1e3d-2048-4201-adae-7e3e72080d82]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-f57df8cf-48d2-470c-ab72-f468dfe77396" released by "delete_volume" :: held 0.948s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Flow 'volume_create_manager' (1989b970-564b-4483-b607-cba2c4782e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e441c4d-a426-42a1-ac1f-ffed1751d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:13 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb Jul 27 13:30:13 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e441c4d-a426-42a1-ac1f-ffed1751d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1057b9-e079-41d1-beee-f75e53286e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b4c26bcff84d4191b20bdcb0165122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:14Z,use_quota=True,user_id='32004cf548134fc78400a14b5df211ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81b0cdd-21e1-411c-82ba-12caeb739bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81b0cdd-21e1-411c-82ba-12caeb739bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeeac95-f2af-44f7-a225-2e2c6f289c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeeac95-f2af-44f7-a225-2e2c6f289c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1057b9-e079-41d1-beee-f75e53286e85', 'volume_name': 'volume-5c1057b9-e079-41d1-beee-f75e53286e85', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc91b9c-2e62-4452-821c-eda0dd38611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc91b9c-2e62-4452-821c-eda0dd38611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4011e6-dec4-43cb-9297-5568f8d66c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:13 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Volume 5c1057b9-e079-41d1-beee-f75e53286e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1057b9-e079-41d1-beee-f75e53286e85', 'volume_size': 1} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1057b9-e079-41d1-beee-f75e53286e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b4c26bcff84d4191b20bdcb0165122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:14Z,use_quota=True,user_id='32004cf548134fc78400a14b5df211ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Creating volume 5c1057b9-e079-41d1-beee-f75e53286e85 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:13 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:13 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 1073741824 Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Created reservations ['8eac589a-efa0-479e-ab68-1688c72cc8e2', '3942e570-c619-4e41-92d5-17f92648284b', 'f64015ec-d347-4f70-9bab-0ce0e95cfbf5', '1b1fab34-6d68-4aa2-90df-be80a1713b2d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:13 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:14 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:14 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:14 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb" returned: 0 in 0.446s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:14 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb Jul 27 13:30:14 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:14 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Deleted volume successfully. Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-30460b7c-baed-4c60-806a-5b4f8472a78c tempest-ProjectReaderTests-210250389 None] Lock "cinder-f57df8cf-48d2-470c-ab72-f468dfe77396-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:14 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 1073741824" returned: 0 in 0.547s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:14 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-d0579c80-c0d1-487e-bfa9-c181a3b981cb" returned: 0 in 0.315s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-d0579c80-c0d1-487e-bfa9-c181a3b981cb" released by "delete_volume" :: held 0.855s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:14 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 Jul 27 13:30:14 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Created reservations ['7dcf22db-55ee-4e4e-bb7d-d97203167bbd', 'db98b09c-3965-4d7a-97fe-5edf6f861106', '4c561f5d-fd0a-4e83-b8dc-e13678269632', '20c0953d-8040-4672-bbd4-26b9329aed35'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:14 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:14 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:14 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85" returned: 0 in 0.285s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4011e6-dec4-43cb-9297-5568f8d66c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1057b9-e079-41d1-beee-f75e53286e85', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f030576-223d-40bf-9cba-b90f619b82a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:14 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Volume volume-5c1057b9-e079-41d1-beee-f75e53286e85 (5c1057b9-e079-41d1-beee-f75e53286e85): created successfully Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f030576-223d-40bf-9cba-b90f619b82a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Flow 'volume_create_manager' (1989b970-564b-4483-b607-cba2c4782e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b215a618-e0b3-474f-9d88-51f22f637f0b tempest-CinderUnicodeTest-1385292568 None] Created volume successfully. Jul 27 13:30:14 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.304s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:14 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Deleted volume successfully. Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-76a162c2-1cc8-47ec-9384-d472f8d2a61e tempest-ProjectReaderTests-1981262615 None] Lock "cinder-d0579c80-c0d1-487e-bfa9-c181a3b981cb-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (505e90fa-77a4-4142-a3b1-bc6d601b6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ec1bf4-b1c0-4301-a777-e9710cc5c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ec1bf4-b1c0-4301-a777-e9710cc5c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849712132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d27689-de79-4eb2-b323-c07d2d6be477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:15Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5e9990-c79b-45cb-b249-add0254b51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5e9990-c79b-45cb-b249-add0254b51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bee5b7c-5049-4be1-b8e0-187da3ad9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bee5b7c-5049-4be1-b8e0-187da3ad9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d27689-de79-4eb2-b323-c07d2d6be477', 'volume_name': 'volume-78d27689-de79-4eb2-b323-c07d2d6be477', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1626de1d-c9f1-43b2-9fe4-145544df6a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1626de1d-c9f1-43b2-9fe4-145544df6a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f46431-7a87-43c2-8143-20c44934cbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Volume 78d27689-de79-4eb2-b323-c07d2d6be477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d27689-de79-4eb2-b323-c07d2d6be477', 'volume_size': 1} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849712132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d27689-de79-4eb2-b323-c07d2d6be477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:15Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Creating volume 78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:15 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:15 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 1073741824 Jul 27 13:30:15 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (efd95bc1-8ad0-4fae-aad8-13fda0e6923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b17904-64bf-4b11-942a-2174c5f2f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b17904-64bf-4b11-942a-2174c5f2f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272372593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:16Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817fb372-562a-40d9-89f8-8779e39db8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817fb372-562a-40d9-89f8-8779e39db8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc273f-d4b5-40b7-a5bc-06c4a3edd86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc273f-d4b5-40b7-a5bc-06c4a3edd86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e', 'volume_name': 'volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6d000f-7a85-45b1-8f57-dfd3ca49d325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6d000f-7a85-45b1-8f57-dfd3ca49d325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68784cd-6ecf-44e6-869a-74dbffb5523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:15 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Volume 6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e', 'volume_size': 1} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:15 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 1073741824" returned: 0 in 0.488s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:15 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 Jul 27 13:30:15 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:16 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477" returned: 0 in 0.302s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272372593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:16Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Creating volume 6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:16 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f46431-7a87-43c2-8143-20c44934cbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d27689-de79-4eb2-b323-c07d2d6be477', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6294156-c2af-4cf9-97cf-b87045a50749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:16 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e 1073741824 Jul 27 13:30:16 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:16 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Volume volume-78d27689-de79-4eb2-b323-c07d2d6be477 (78d27689-de79-4eb2-b323-c07d2d6be477): created successfully Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6294156-c2af-4cf9-97cf-b87045a50749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (505e90fa-77a4-4142-a3b1-bc6d601b6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:16 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8900f52c-e89f-4510-ab30-ffc134cf6cc7 tempest-ProjectReaderTests-1981262615 None] Created volume successfully. Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Flow 'volume_create_manager' (5ff6a46c-0226-4d07-9cda-4e3406df89c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3363e474-ecb6-4fa0-bd5f-e4a542df55bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3363e474-ecb6-4fa0-bd5f-e4a542df55bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-79441520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc96c9e1-0464-494b-add9-fae6c420cdf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b4c26bcff84d4191b20bdcb0165122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:17Z,use_quota=True,user_id='32004cf548134fc78400a14b5df211ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42321252-beaf-4b59-ae48-c682fd429062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42321252-beaf-4b59-ae48-c682fd429062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6df6405-5da6-47c8-8ad8-f6bb44acf367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6df6405-5da6-47c8-8ad8-f6bb44acf367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc96c9e1-0464-494b-add9-fae6c420cdf3', 'volume_name': 'volume-fc96c9e1-0464-494b-add9-fae6c420cdf3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce341063-4a11-4818-ba8f-e362d01ae98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce341063-4a11-4818-ba8f-e362d01ae98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b242ce6-eb31-4656-bb94-6dc1886b6fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:16 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Volume fc96c9e1-0464-494b-add9-fae6c420cdf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc96c9e1-0464-494b-add9-fae6c420cdf3', 'volume_size': 1} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:16 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e 1073741824" returned: 0 in 0.563s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:16 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e Jul 27 13:30:16 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:17 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e" returned: 0 in 0.285s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-79441520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc96c9e1-0464-494b-add9-fae6c420cdf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b4c26bcff84d4191b20bdcb0165122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:17Z,use_quota=True,user_id='32004cf548134fc78400a14b5df211ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Creating volume fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:17 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68784cd-6ecf-44e6-869a-74dbffb5523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55be38d0-7afd-4d57-9143-7fcec36c3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:17 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 1073741824 Jul 27 13:30:17 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:17 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Volume volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e (6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e): created successfully Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55be38d0-7afd-4d57-9143-7fcec36c3246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (efd95bc1-8ad0-4fae-aad8-13fda0e6923d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:17 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0df02fdd-00ae-447d-af92-97edf984291f tempest-ProjectReaderTests-210250389 None] Created volume successfully. Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:17 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 1073741824" returned: 0 in 0.500s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:17 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 Jul 27 13:30:17 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Lock "cinder-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-quobyte-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[925824c2-4db0-410e-989d-ed89ce76be68]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:17 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3" returned: 0 in 0.301s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.479s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b242ce6-eb31-4656-bb94-6dc1886b6fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc96c9e1-0464-494b-add9-fae6c420cdf3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c9fb4d-7c50-4a05-9cde-82b2aa5cfb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Creating offline snapshot 99bfa7da-73eb-4d06-80a2-29c009401116 of volume 78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:17 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Volume volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 (fc96c9e1-0464-494b-add9-fae6c420cdf3): created successfully Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c9fb4d-7c50-4a05-9cde-82b2aa5cfb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:17 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Flow 'volume_create_manager' (5ff6a46c-0226-4d07-9cda-4e3406df89c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dee389-e918-4423-97ef-d95e49778362]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:18 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e Jul 27 13:30:18 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b123fee8-618e-488a-a961-b55fef2458c3 tempest-CinderUnicodeTest-1385292568 None] Created volume successfully. Jul 27 13:30:18 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:18 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 Jul 27 13:30:18 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:18 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e" returned: 0 in 0.403s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:18 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e Jul 27 13:30:18 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:18 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477" returned: 0 in 0.397s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:18 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 1G Jul 27 13:30:18 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:18 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e" returned: 0 in 0.304s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e" released by "delete_volume" :: held 0.775s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Created reservations ['6f5f33b3-df57-4fdf-8af4-3c5e42b3f3d6', 'a7c9fa17-9378-47b9-97a5-12fdb2914fff', 'f22984e0-1414-41fe-9b46-01bf1ef3b356', 'fdf2a5f5-2800-4694-b53f-6c18a4dca797'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:18 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:18 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:18 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 1G" returned: 0 in 0.552s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d27689-de79-4eb2-b323-c07d2d6be477 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:19 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d27689-de79-4eb2-b323-c07d2d6be477 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 Jul 27 13:30:19 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:19 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:19 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Deleted volume successfully. Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-930fbb6e-df01-47d4-b508-79d932d71744 tempest-ProjectReaderTests-210250389 None] Lock "cinder-6d2a2e6e-58aa-4ec2-b6ef-20d32bf4c20e-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:19 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d27689-de79-4eb2-b323-c07d2d6be477 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116" returned: 0 in 0.426s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:19 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 is being set with open permissions: ugo+rw Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:19 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 Jul 27 13:30:19 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (f84c3170-041b-438d-9bd4-27135d438f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf83de9f-d766-4a38-9f0b-a45c034df4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf83de9f-d766-4a38-9f0b-a45c034df4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130021074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c5e693-0277-41bd-b71e-964d42605a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:19Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd24d777-add9-4fa1-9462-67ecb25a889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd24d777-add9-4fa1-9462-67ecb25a889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e46eeb-bb22-4a44-8fe4-0600a3eb3e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e46eeb-bb22-4a44-8fe4-0600a3eb3e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c5e693-0277-41bd-b71e-964d42605a97', 'volume_name': 'volume-a8c5e693-0277-41bd-b71e-964d42605a97', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233c7b07-ee43-4226-bf67-91efc8b166a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233c7b07-ee43-4226-bf67-91efc8b166a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02359099-14d3-4831-ab0d-216f15a31ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:19 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Volume a8c5e693-0277-41bd-b71e-964d42605a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c5e693-0277-41bd-b71e-964d42605a97', 'volume_size': 1} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:19 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116" returned: 0 in 0.317s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:19 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info Jul 27 13:30:19 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:19 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:19 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info is being set with open permissions: ugo+rw Jul 27 13:30:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:20 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info Jul 27 13:30:20 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:20 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.info" returned: 0 in 0.245s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.252s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Creating offline snapshot 5444ae12-fc79-4fb8-9cac-a43d692e63fd of volume fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8346f51a-b3d3-45b5-b19b-36b3065af2e8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:20 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-48796f83-e64a-4ce3-bbe7-6879dad386e5 tempest-ProjectReaderTests-1981262615 None] Create snapshot completed successfully Jul 27 13:30:20 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 Jul 27 13:30:20 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-99bfa7da-73eb-4d06-80a2-29c009401116-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:20 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3" returned: 0 in 0.379s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-99bfa7da-73eb-4d06-80a2-29c009401116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-78d27689-de79-4eb2-b323-c07d2d6be477" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:20 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd 1G Jul 27 13:30:20 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-78d27689-de79-4eb2-b323-c07d2d6be477" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-99bfa7da-73eb-4d06-80a2-29c009401116" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-99bfa7da-73eb-4d06-80a2-29c009401116" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Deleting offline snapshot 99bfa7da-73eb-4d06-80a2-29c009401116 of volume 78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] snapshot_file for this snap is: volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a57ce1-d823-4db2-aa19-c41d9c4f7f61]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:20 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 Jul 27 13:30:20 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:21 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd 1G" returned: 0 in 0.532s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:21 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116" returned: 0 in 0.429s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d27689-de79-4eb2-b323-c07d2d6be477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:21 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd Jul 27 13:30:21 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fda077-fb30-4117-a82a-9d7d3ecf355a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:21 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 Jul 27 13:30:21 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:21 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd" returned: 0 in 0.351s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:21 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd is being set with open permissions: ugo+rw Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:21 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd Jul 27 13:30:21 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:21 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477" returned: 0 in 0.421s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:21 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 Jul 27 13:30:21 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:21 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd" returned: 0 in 0.282s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:21 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info Jul 27 13:30:21 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:22 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116" returned: 0 in 0.357s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:22 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116 Jul 27 13:30:22 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:22 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:22 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info is being set with open permissions: ugo+rw Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:22 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info Jul 27 13:30:22 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:22 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477.99bfa7da-73eb-4d06-80a2-29c009401116" returned: 0 in 0.252s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-99bfa7da-73eb-4d06-80a2-29c009401116" released by "_delete_snapshot" :: held 1.576s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-78d27689-de79-4eb2-b323-c07d2d6be477" released by "delete_snapshot" :: held 1.604s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=236,cinder:UPDATE=319,cinder:DELETE=24,cinder:INSERT=89 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=215,cinder:UPDATE=301,cinder:INSERT=74,cinder:DELETE=33 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:30:22 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Created reservations ['b40c72b9-9b38-4b86-ba08-cc67dec30b93', '8779169d-e7de-4d6c-a26a-8ccad4e8b85e', '54c1e08c-c0cc-4704-8c76-99eca9121dad', '382643c3-185f-44cf-9e27-77ab996db7e4'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.info" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.809s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130021074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c5e693-0277-41bd-b71e-964d42605a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce42a5d83eb642d1aae54bd93e7eebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:19Z,use_quota=True,user_id='f736e56f1fcf4686984172f331db45bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Creating volume a8c5e693-0277-41bd-b71e-964d42605a97 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:22 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:22 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 1073741824 Jul 27 13:30:22 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-36935275-df94-4f5b-90dd-c6dc09beb000 tempest-CinderUnicodeTest-1385292568 None] Create snapshot completed successfully Jul 27 13:30:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Delete snapshot completed successfully. Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5681fde3-8ca0-4f7b-8b7c-79ab9b9d66d2 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-99bfa7da-73eb-4d06-80a2-29c009401116-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-78d27689-de79-4eb2-b323-c07d2d6be477-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Lock "cinder-78d27689-de79-4eb2-b323-c07d2d6be477-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-78d27689-de79-4eb2-b323-c07d2d6be477" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-78d27689-de79-4eb2-b323-c07d2d6be477" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e197609-9703-402d-bf15-887ff963121b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:22 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 1073741824" returned: 0 in 0.545s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:23 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 Jul 27 13:30:23 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:23 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 Jul 27 13:30:23 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:23 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97" returned: 0 in 0.298s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-5444ae12-fc79-4fb8-9cac-a43d692e63fd-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02359099-14d3-4831-ab0d-216f15a31ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c5e693-0277-41bd-b71e-964d42605a97', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e4ef6-b1b6-4a44-b2b0-afa07c82670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:23 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Volume volume-a8c5e693-0277-41bd-b71e-964d42605a97 (a8c5e693-0277-41bd-b71e-964d42605a97): created successfully Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e4ef6-b1b6-4a44-b2b0-afa07c82670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Flow 'volume_create_manager' (f84c3170-041b-438d-9bd4-27135d438f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-5444ae12-fc79-4fb8-9cac-a43d692e63fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-quobyte-fc96c9e1-0464-494b-add9-fae6c420cdf3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-43c49a7e-e0fc-453b-8df4-15118d3c8654 tempest-ProjectReaderTests-210250389 None] Created volume successfully. Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-fc96c9e1-0464-494b-add9-fae6c420cdf3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-quobyte-5444ae12-fc79-4fb8-9cac-a43d692e63fd" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:23 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477" returned: 0 in 0.457s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-5444ae12-fc79-4fb8-9cac-a43d692e63fd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Deleting offline snapshot 5444ae12-fc79-4fb8-9cac-a43d692e63fd of volume fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:23 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477 Jul 27 13:30:23 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] snapshot_file for this snap is: volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[906c7732-cbbf-4f36-94b7-672694417e67]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:23 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd Jul 27 13:30:23 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:23 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-78d27689-de79-4eb2-b323-c07d2d6be477" returned: 0 in 0.331s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-a8c5e693-0277-41bd-b71e-964d42605a97-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-78d27689-de79-4eb2-b323-c07d2d6be477" released by "delete_volume" :: held 0.874s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Lock "cinder-a8c5e693-0277-41bd-b71e-964d42605a97-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Acquiring lock "cinder-quobyte-a8c5e693-0277-41bd-b71e-964d42605a97" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Created reservations ['a94a85a3-1a62-41a7-a50b-ddafe979375d', '5e0ae017-47b0-4bbe-bb38-a54017e1d5cd', 'f3c1190a-4b14-4983-81e2-317884d1c4ad', 'd4670e6e-27d0-4aea-8f38-77d1197c210b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-a8c5e693-0277-41bd-b71e-964d42605a97" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf3d6e8-2292-4129-bc24-126fe6bfa546]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:23 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd" returned: 0 in 0.467s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc96c9e1-0464-494b-add9-fae6c420cdf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8828819-15f8-45e6-baf7-af50e3edb304]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:24 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 Jul 27 13:30:24 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:24 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 Jul 27 13:30:24 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.341s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:24 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Deleted volume successfully. Jul 27 13:30:24 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97" returned: 0 in 0.494s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:24 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bbea98e2-ecac-45ad-81c5-5ee0c357c6ac tempest-ProjectReaderTests-1981262615 None] Lock "cinder-78d27689-de79-4eb2-b323-c07d2d6be477-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3" returned: 0 in 0.448s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:24 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97 Jul 27 13:30:24 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd Jul 27 13:30:24 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (dabf235d-556b-4970-88cd-c032feda9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5392331-9379-4956-b4c8-d3e60dd2160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5392331-9379-4956-b4c8-d3e60dd2160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-414363816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656ddf5f-a755-4c68-a932-f9bf3d9ad72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:25Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877f0661-f801-4fb4-81d0-e93ea196e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877f0661-f801-4fb4-81d0-e93ea196e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaa3990-262a-4877-b683-fa02315c5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaa3990-262a-4877-b683-fa02315c5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656ddf5f-a755-4c68-a932-f9bf3d9ad72b', 'volume_name': 'volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b600934-c31b-475e-aecd-c8793dc758a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b600934-c31b-475e-aecd-c8793dc758a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1db9b7c-61a8-4747-a7c7-d57d519d0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:24 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Volume 656ddf5f-a755-4c68-a932-f9bf3d9ad72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b', 'volume_size': 1} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-414363816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656ddf5f-a755-4c68-a932-f9bf3d9ad72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:25Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Creating volume 656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:24 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:24 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b 1073741824 Jul 27 13:30:24 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a8c5e693-0277-41bd-b71e-964d42605a97" returned: 0 in 0.299s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Lock "cinder-quobyte-a8c5e693-0277-41bd-b71e-964d42605a97" released by "delete_volume" :: held 0.846s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Created reservations ['1cef008b-c4ec-4d8d-a989-20b4ff538a13', '9d6ba534-fb34-461d-a600-6cde3e943626', 'c52a2d1a-9fa6-4465-9d00-92ae8cdb8dc3', '2d9c8014-6ce7-40d8-a31a-2d0449e2b301'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:24 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:24 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:24 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd" returned: 0 in 0.519s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:25 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd Jul 27 13:30:25 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:25 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b 1073741824" returned: 0 in 0.600s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:25 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3.5444ae12-fc79-4fb8-9cac-a43d692e63fd" returned: 0 in 0.310s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:25 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.379s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Deleted volume successfully. Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-5444ae12-fc79-4fb8-9cac-a43d692e63fd" released by "_delete_snapshot" :: held 1.903s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-fc96c9e1-0464-494b-add9-fae6c420cdf3" released by "delete_snapshot" :: held 1.950s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-34cc5265-f321-4a1e-beab-c5cce6c6618d tempest-ProjectReaderTests-210250389 None] Lock "cinder-a8c5e693-0277-41bd-b71e-964d42605a97-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:25 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b Jul 27 13:30:25 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Created reservations ['e93597ed-a623-4bcc-ac3a-b69b5dc5c381', 'e28ec6f8-e836-4f1e-b976-39d7afd6964b', '0a800254-7240-49c2-ace5-ed124cebd4a1', '73e937e5-5269-4eb6-99a0-bdd9435e7705'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Delete snapshot completed successfully. Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4800632e-ad62-49bd-abac-f0720d43dddf tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-5444ae12-fc79-4fb8-9cac-a43d692e63fd-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:25 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" returned: 0 in 0.342s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1db9b7c-61a8-4747-a7c7-d57d519d0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee9266b-d329-44eb-8a18-30af1fc7a3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Volume volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b (656ddf5f-a755-4c68-a932-f9bf3d9ad72b): created successfully Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee9266b-d329-44eb-8a18-30af1fc7a3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (dabf235d-556b-4970-88cd-c032feda9e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:25 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-04aa1449-4e02-4b56-a3fa-cd10399d13a5 tempest-ProjectReaderTests-1981262615 None] Created volume successfully. Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-fc96c9e1-0464-494b-add9-fae6c420cdf3-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-fc96c9e1-0464-494b-add9-fae6c420cdf3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-quobyte-fc96c9e1-0464-494b-add9-fae6c420cdf3" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-fc96c9e1-0464-494b-add9-fae6c420cdf3" acquired by "delete_volume" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[057d75fa-09d0-4584-9bdc-e4a59bd5474e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Creating offline snapshot 06657d6c-ec7d-4699-8f1f-7647ebc2edad of volume 656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5b16f2-dde1-437b-b5fa-0dfd2ad889fa]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:27 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 Jul 27 13:30:27 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:27 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b Jul 27 13:30:27 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:27 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3" returned: 0 in 0.472s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:27 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3 Jul 27 13:30:27 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:27 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:27 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad 1G Jul 27 13:30:27 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:27 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-fc96c9e1-0464-494b-add9-fae6c420cdf3" returned: 0 in 0.300s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-fc96c9e1-0464-494b-add9-fae6c420cdf3" released by "delete_volume" :: held 0.902s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Created reservations ['92e285b9-e3a6-4fb8-8c57-d89b05a51436', '864783cd-2461-48fa-b21d-aeed128aa3ed', '059e6e05-bb7a-4d3e-8deb-0bd83450c983', 'eb4c5878-82a5-43f9-a9a7-4028420139a9'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:27 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:27 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:27 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad 1G" returned: 0 in 0.513s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:27 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad Jul 27 13:30:27 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:28 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Deleted volume successfully. Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-f899de37-6b8a-4cc9-a63b-643b557bdcda tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-fc96c9e1-0464-494b-add9-fae6c420cdf3-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:28 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad" returned: 0 in 0.311s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:28 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad is being set with open permissions: ugo+rw Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:28 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad Jul 27 13:30:28 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:28 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad" returned: 0 in 0.260s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:28 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info Jul 27 13:30:28 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:28 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info" returned: 0 in 0.247s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:28 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info is being set with open permissions: ugo+rw Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:28 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info Jul 27 13:30:28 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-5c1057b9-e079-41d1-beee-f75e53286e85-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-5c1057b9-e079-41d1-beee-f75e53286e85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "cinder-quobyte-5c1057b9-e079-41d1-beee-f75e53286e85" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-5c1057b9-e079-41d1-beee-f75e53286e85" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:29 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.info" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b2842-c74c-4baf-a145-c8dd4bba95d0]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:29 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7462960d-df32-4903-839f-486ffede2b5c tempest-ProjectReaderTests-1981262615 None] Create snapshot completed successfully Jul 27 13:30:29 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 Jul 27 13:30:29 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:29 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Flow 'volume_create_manager' (95058124-20c9-4e79-8c5a-f0995b89802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25070778-781f-4843-9d5b-fe18e97eac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85" returned: 0 in 0.411s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25070778-781f-4843-9d5b-fe18e97eac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428332088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a149a338-e7bd-4f30-9e30-2d424c12f841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ac7a782134ae4bbc15f0e525a985c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:29Z,use_quota=True,user_id='8b3b134670c84f28b6ecbf4fc70800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:29 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85 Jul 27 13:30:29 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ffb3ed-74db-49a3-954f-ef9e79d3e7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ffb3ed-74db-49a3-954f-ef9e79d3e7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06991d58-1d8c-4800-b21a-537653b5c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06991d58-1d8c-4800-b21a-537653b5c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a149a338-e7bd-4f30-9e30-2d424c12f841', 'volume_name': 'volume-a149a338-e7bd-4f30-9e30-2d424c12f841', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0396813-058b-46d0-b71e-676bd308d4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0396813-058b-46d0-b71e-676bd308d4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bb7e18-ae15-4d5b-b9e4-f1ede1b49a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:29 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Volume a149a338-e7bd-4f30-9e30-2d424c12f841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a149a338-e7bd-4f30-9e30-2d424c12f841', 'volume_size': 1} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428332088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a149a338-e7bd-4f30-9e30-2d424c12f841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ac7a782134ae4bbc15f0e525a985c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:29Z,use_quota=True,user_id='8b3b134670c84f28b6ecbf4fc70800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Creating volume a149a338-e7bd-4f30-9e30-2d424c12f841 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:29 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:29 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 1073741824 Jul 27 13:30:29 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:29 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5c1057b9-e079-41d1-beee-f75e53286e85" returned: 0 in 0.244s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-quobyte-5c1057b9-e079-41d1-beee-f75e53286e85" released by "delete_volume" :: held 0.710s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Created reservations ['ac18cfe8-1f66-40fd-88f4-e685e8d87534', '5e748703-8782-45b8-8825-0fcb2ebcc140', 'e168b02d-d08b-4699-918d-cf8b31045e65', '4333ba2f-c3d8-4cb0-9626-5fe3da4b9376'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:29 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:29 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:30 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 1073741824" returned: 0 in 0.450s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:30 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 Jul 27 13:30:30 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-06657d6c-ec7d-4699-8f1f-7647ebc2edad-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Lock "cinder-06657d6c-ec7d-4699-8f1f-7647ebc2edad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-06657d6c-ec7d-4699-8f1f-7647ebc2edad" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-06657d6c-ec7d-4699-8f1f-7647ebc2edad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Deleting offline snapshot 06657d6c-ec7d-4699-8f1f-7647ebc2edad of volume 656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:30 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] snapshot_file for this snap is: volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.335s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Deleted volume successfully. Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa1024-c17d-4ec6-bb00-4e37edd7d8bf]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-0e058202-a231-4bf1-9298-96a2529b18ae tempest-CinderUnicodeTest-1385292568 None] Lock "cinder-5c1057b9-e079-41d1-beee-f75e53286e85-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:30 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841" returned: 0 in 0.308s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:30 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad Jul 27 13:30:30 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bb7e18-ae15-4d5b-b9e4-f1ede1b49a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a149a338-e7bd-4f30-9e30-2d424c12f841', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e59cda3-130a-4f66-a433-115833eda9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Volume volume-a149a338-e7bd-4f30-9e30-2d424c12f841 (a149a338-e7bd-4f30-9e30-2d424c12f841): created successfully Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e59cda3-130a-4f66-a433-115833eda9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Flow 'volume_create_manager' (95058124-20c9-4e79-8c5a-f0995b89802f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a0786fb0-255d-49fc-a3a5-fc5054979fbc tempest-ProjectReaderTests-821643660 None] Created volume successfully. Jul 27 13:30:30 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad" returned: 0 in 0.408s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1dc525-aa73-4848-885d-c8736bb678b2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:30 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b Jul 27 13:30:30 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:31 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" returned: 0 in 0.414s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:31 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad Jul 27 13:30:31 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:31 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:31 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad Jul 27 13:30:31 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:31 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b.06657d6c-ec7d-4699-8f1f-7647ebc2edad" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-06657d6c-ec7d-4699-8f1f-7647ebc2edad" released by "_delete_snapshot" :: held 1.590s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" released by "delete_snapshot" :: held 1.615s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Created reservations ['bea78476-add3-4fef-892b-dac0f6f9b1da', '49a6524f-8c02-4e5f-9b9f-74cdbd0f0756', '88bd28b9-9972-49c1-9afc-0b2432797295', 'fc6731a6-08ad-4a90-8434-c8c98c833e96'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Acquiring lock "cinder-a149a338-e7bd-4f30-9e30-2d424c12f841-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Lock "cinder-a149a338-e7bd-4f30-9e30-2d424c12f841-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Delete snapshot completed successfully. Jul 27 13:30:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-02427c0f-0684-469d-9c10-0e99bb10abaa tempest-ProjectReaderTests-1981262615 None] Lock "cinder-06657d6c-ec7d-4699-8f1f-7647ebc2edad-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Acquiring lock "cinder-quobyte-a149a338-e7bd-4f30-9e30-2d424c12f841" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Lock "cinder-quobyte-a149a338-e7bd-4f30-9e30-2d424c12f841" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad73862-ca70-4f3d-8c82-e7f5c2fc1633]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:32 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 Jul 27 13:30:32 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-656ddf5f-a755-4c68-a932-f9bf3d9ad72b-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-656ddf5f-a755-4c68-a932-f9bf3d9ad72b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2fc611-4786-49b4-ba2c-34fc317a9f65]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:32 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841" returned: 0 in 0.465s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:32 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841 Jul 27 13:30:32 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:32 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b Jul 27 13:30:32 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:32 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-a149a338-e7bd-4f30-9e30-2d424c12f841" returned: 0 in 0.282s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Lock "cinder-quobyte-a149a338-e7bd-4f30-9e30-2d424c12f841" released by "delete_volume" :: held 0.800s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:32 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" returned: 0 in 0.394s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:32 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b Jul 27 13:30:32 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Created reservations ['62a962bd-22e1-49ee-809f-6305787a6aaa', 'a8250248-95f3-40c5-b9dc-79ff430b5930', '8ed8a047-cc9b-4336-afaf-24d5f8095586', 'e358fe86-02ac-42df-a3d1-b84d6c4509c8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:33 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:33 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:33 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:33 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:33 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-656ddf5f-a755-4c68-a932-f9bf3d9ad72b" released by "delete_volume" :: held 0.849s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:33 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.323s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Deleted volume successfully. Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-18d364e9-9abe-44d1-ba04-ddc6d52fff3a tempest-ProjectReaderTests-821643660 None] Lock "cinder-a149a338-e7bd-4f30-9e30-2d424c12f841-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Created reservations ['6f70120c-dbf7-4cbe-bf30-9c5b147ca096', 'caf11353-646c-415e-9559-9966f53ce21b', 'aa560475-9b87-48dc-be80-3be0851b4da2', '3d38b561-2edc-48b2-9342-3f949443dcb9'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:33 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.336s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:33 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:33 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Flow 'volume_create_manager' (13b849c4-abcf-4a0c-a8da-381771f24dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0922a554-5c9c-42c3-91b6-74910a41f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0922a554-5c9c-42c3-91b6-74910a41f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417808729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8297ce07-82ef-4c7e-8006-b29e29309cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ac7a782134ae4bbc15f0e525a985c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:34Z,use_quota=True,user_id='8b3b134670c84f28b6ecbf4fc70800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480c6906-02b7-4699-9a56-c443906bb329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480c6906-02b7-4699-9a56-c443906bb329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6299a3a1-60ea-4508-a144-d658e68fc77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6299a3a1-60ea-4508-a144-d658e68fc77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8297ce07-82ef-4c7e-8006-b29e29309cdb', 'volume_name': 'volume-8297ce07-82ef-4c7e-8006-b29e29309cdb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f5fe35-ed5a-4e8d-9fde-75eec8c64628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f5fe35-ed5a-4e8d-9fde-75eec8c64628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ba6ac4-0fe3-4ff9-a476-7687c003cf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:33 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Volume 8297ce07-82ef-4c7e-8006-b29e29309cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8297ce07-82ef-4c7e-8006-b29e29309cdb', 'volume_size': 1} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417808729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8297ce07-82ef-4c7e-8006-b29e29309cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ac7a782134ae4bbc15f0e525a985c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:34Z,use_quota=True,user_id='8b3b134670c84f28b6ecbf4fc70800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Creating volume 8297ce07-82ef-4c7e-8006-b29e29309cdb {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:33 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:33 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.354s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:33 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Deleted volume successfully. Jul 27 13:30:33 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb 1073741824 Jul 27 13:30:33 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-74b22658-c28c-4619-bcfb-3f6154423ce6 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-656ddf5f-a755-4c68-a932-f9bf3d9ad72b-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:33 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (ab2d6470-9acb-4287-a4f6-dc8ad74c1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b814ea1-430e-4b6c-99d5-95386b71d969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b814ea1-430e-4b6c-99d5-95386b71d969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216007610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddaccde-cf5d-4109-a5a0-67af8e0450d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:34Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afea237-4ded-44a3-bb03-1cdad08055c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afea237-4ded-44a3-bb03-1cdad08055c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c613c09d-9bd5-4574-bb0d-8e180606ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c613c09d-9bd5-4574-bb0d-8e180606ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddaccde-cf5d-4109-a5a0-67af8e0450d3', 'volume_name': 'volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006d7b69-ebd8-4878-b5b3-b75073f990fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006d7b69-ebd8-4878-b5b3-b75073f990fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32c0f07-4b89-47fd-a641-8ce09e4e936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:34 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Volume 4ddaccde-cf5d-4109-a5a0-67af8e0450d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3', 'volume_size': 1} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:34 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb 1073741824" returned: 0 in 0.498s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:34 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb Jul 27 13:30:34 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:34 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216007610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddaccde-cf5d-4109-a5a0-67af8e0450d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:34Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Creating volume 4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:34 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ba6ac4-0fe3-4ff9-a476-7687c003cf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8297ce07-82ef-4c7e-8006-b29e29309cdb', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:34 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 1073741824 Jul 27 13:30:34 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee215b1-c8af-466f-83f9-95955619ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:34 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Volume volume-8297ce07-82ef-4c7e-8006-b29e29309cdb (8297ce07-82ef-4c7e-8006-b29e29309cdb): created successfully Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee215b1-c8af-466f-83f9-95955619ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:34 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Flow 'volume_create_manager' (13b849c4-abcf-4a0c-a8da-381771f24dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:34 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-f660b84c-2500-46ca-ae72-d30a23ce0f23 tempest-ProjectReaderTests-821643660 None] Created volume successfully. Jul 27 13:30:35 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 1073741824" returned: 0 in 0.466s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:35 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 Jul 27 13:30:35 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:35 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" returned: 0 in 0.260s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32c0f07-4b89-47fd-a641-8ce09e4e936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42765b9-5092-4fda-ba92-0a68cc8472f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:35 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Volume volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 (4ddaccde-cf5d-4109-a5a0-67af8e0450d3): created successfully Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42765b9-5092-4fda-ba92-0a68cc8472f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (ab2d6470-9acb-4287-a4f6-dc8ad74c1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:35 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7d87014c-425a-460d-98c4-8a7550b2c2db tempest-ProjectReaderTests-1981262615 None] Created volume successfully. Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Acquiring lock "cinder-8297ce07-82ef-4c7e-8006-b29e29309cdb-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Lock "cinder-8297ce07-82ef-4c7e-8006-b29e29309cdb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Acquiring lock "cinder-quobyte-8297ce07-82ef-4c7e-8006-b29e29309cdb" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Lock "cinder-quobyte-8297ce07-82ef-4c7e-8006-b29e29309cdb" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d757e1db-5347-4603-b32f-a12530138a21]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:35 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:36 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb Jul 27 13:30:36 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Creating offline snapshot fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 of volume 4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:36 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb" returned: 0 in 0.456s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c979132d-336a-43f0-8909-6d4fefce0c4b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:36 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb Jul 27 13:30:36 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:36 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 Jul 27 13:30:36 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:36 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8297ce07-82ef-4c7e-8006-b29e29309cdb" returned: 0 in 0.256s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Lock "cinder-quobyte-8297ce07-82ef-4c7e-8006-b29e29309cdb" released by "delete_volume" :: held 0.756s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Created reservations ['846c8f59-775d-4329-9dd0-cb2c4a07f4e4', 'd0c6cea7-faf2-4f64-bfe0-8bec7ebe76dd', '75572056-10b5-487f-a602-77f7e961e799', '88226dac-9c6b-43eb-a3f2-ce9cc1613224'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:36 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:36 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:36 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" returned: 0 in 0.467s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:36 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 1G Jul 27 13:30:36 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:37 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.322s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Deleted volume successfully. Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-ba2a04af-ff79-4961-8afa-101d5bad1041 tempest-ProjectReaderTests-821643660 None] Lock "cinder-8297ce07-82ef-4c7e-8006-b29e29309cdb-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:37 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 1G" returned: 0 in 0.557s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:37 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 Jul 27 13:30:37 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:37 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" returned: 0 in 0.327s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:37 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 is being set with open permissions: ugo+rw Jul 27 13:30:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:37 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 Jul 27 13:30:37 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:38 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" returned: 0 in 0.283s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:38 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info Jul 27 13:30:38 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:38 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info" returned: 0 in 0.318s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:38 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info is being set with open permissions: ugo+rw Jul 27 13:30:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:38 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info Jul 27 13:30:38 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:38 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.info" returned: 0 in 0.273s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:38 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5836024b-10b4-4543-b460-0cb94c465e54 tempest-ProjectReaderTests-1981262615 None] Create snapshot completed successfully Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (1e860ca3-87ce-4982-a681-c5594e0705a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8a17b2-d306-41bc-964c-fcf80a729c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8a17b2-d306-41bc-964c-fcf80a729c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916786830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36327e38-3b9d-490b-9a6e-029d785303cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:39Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92369cb-56c9-4440-96ea-c8e490196cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92369cb-56c9-4440-96ea-c8e490196cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08d98ff-8456-426e-8efb-a5abb45c4d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08d98ff-8456-426e-8efb-a5abb45c4d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36327e38-3b9d-490b-9a6e-029d785303cc', 'volume_name': 'volume-36327e38-3b9d-490b-9a6e-029d785303cc', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2f27dd-ded1-44fe-abc3-064517c64b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2f27dd-ded1-44fe-abc3-064517c64b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4231ba-8c6f-4ca0-aefc-c322b0f33817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:39 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Volume 36327e38-3b9d-490b-9a6e-029d785303cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36327e38-3b9d-490b-9a6e-029d785303cc', 'volume_size': 1} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916786830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36327e38-3b9d-490b-9a6e-029d785303cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:39Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Creating volume 36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:39 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:39 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc 1073741824 Jul 27 13:30:39 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-fbd1f830-6c25-4436-8a7b-76fd3edd5ca0-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Lock "cinder-fbd1f830-6c25-4436-8a7b-76fd3edd5ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Deleting offline snapshot fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 of volume 4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] snapshot_file for this snap is: volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[654848ef-d7ef-4cc1-95d8-506bdcc88b65]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:39 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 Jul 27 13:30:39 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:39 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc 1073741824" returned: 0 in 0.539s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:39 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc Jul 27 13:30:39 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:40 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:40 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" returned: 0 in 0.436s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc" returned: 0 in 0.293s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4231ba-8c6f-4ca0-aefc-c322b0f33817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36327e38-3b9d-490b-9a6e-029d785303cc', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a78a06e-fdd5-4439-a44d-c65b57b0ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b1679b-2efd-4f22-bb4a-f5230bde9ddd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:40 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Volume volume-36327e38-3b9d-490b-9a6e-029d785303cc (36327e38-3b9d-490b-9a6e-029d785303cc): created successfully Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a78a06e-fdd5-4439-a44d-c65b57b0ff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (1e860ca3-87ce-4982-a681-c5594e0705a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:40 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7d90432b-751d-402d-b13d-7c97278977bc tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:30:40 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 Jul 27 13:30:40 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:40 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" returned: 0 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:40 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 Jul 27 13:30:40 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:40 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:40 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0 Jul 27 13:30:40 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:41 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3.fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" returned: 0 in 0.268s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-fbd1f830-6c25-4436-8a7b-76fd3edd5ca0" released by "_delete_snapshot" :: held 1.597s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" released by "delete_snapshot" :: held 1.624s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Created reservations ['332043a2-8495-426b-b1c3-9727fe3691c2', '25cd3c89-98cb-4407-862e-0f2706cae612', '3d1687e4-d6f9-4ebc-ab36-5dc802235c05', '73fdbae5-b0ff-4bea-9537-631c4cf6756d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Delete snapshot completed successfully. Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-9c4b202f-0c67-45a2-9c02-655f4ae9c3ae tempest-ProjectReaderTests-1981262615 None] Lock "cinder-fbd1f830-6c25-4436-8a7b-76fd3edd5ca0-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Creating offline snapshot 795f6b81-1c0e-40a4-9f09-c236ddd80eba of volume 36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[666bfaa2-998b-475d-89bf-709875bb5dc6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-4ddaccde-cf5d-4109-a5a0-67af8e0450d3-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-4ddaccde-cf5d-4109-a5a0-67af8e0450d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:41 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc Jul 27 13:30:41 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c96b0-c3cf-4b4f-9182-5f337d62a86a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:42 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 Jul 27 13:30:42 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:42 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:42 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba 1G Jul 27 13:30:42 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:42 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" returned: 0 in 0.447s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:42 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3 Jul 27 13:30:42 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:42 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba 1G" returned: 0 in 0.485s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36327e38-3b9d-490b-9a6e-029d785303cc -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:42 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36327e38-3b9d-490b-9a6e-029d785303cc -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba Jul 27 13:30:42 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:42 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" returned: 0 in 0.317s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-4ddaccde-cf5d-4109-a5a0-67af8e0450d3" released by "delete_volume" :: held 0.856s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Created reservations ['3ebdffbd-955d-4499-ab4b-f93a82b87571', '686d9dce-ab8c-4c02-a499-9f6aba07fa4b', '74d0c353-c6e7-4f07-b783-9297dbbd2d3b', '0e51dcbf-94cc-4177-9dbb-b0da5fb51a0b'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:42 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:42 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:43 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36327e38-3b9d-490b-9a6e-029d785303cc -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba" returned: 0 in 0.394s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:43 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba is being set with open permissions: ugo+rw Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:43 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba Jul 27 13:30:43 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:43 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Deleted volume successfully. Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-410de4bb-1900-436d-930d-17bb4e47ae85 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-4ddaccde-cf5d-4109-a5a0-67af8e0450d3-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:43 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba" returned: 0 in 0.387s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:43 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info Jul 27 13:30:43 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (3182ffaf-7bc1-47f8-b25a-f51e1f20cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b9ce07-a637-442c-b46a-7f26cdb70b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b9ce07-a637-442c-b46a-7f26cdb70b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137009791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171e5ba6-d080-4815-a5ae-a8a6251b95ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:43Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b66f0c2-1806-4ce4-a057-66581cac3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b66f0c2-1806-4ce4-a057-66581cac3d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de30297-fd23-4049-ac12-ccfdd0043a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de30297-fd23-4049-ac12-ccfdd0043a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171e5ba6-d080-4815-a5ae-a8a6251b95ce', 'volume_name': 'volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae63c06-6a15-41cb-9350-2d4a713d780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae63c06-6a15-41cb-9350-2d4a713d780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9833f0c8-2232-4629-8fa9-b83c5eb54571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:43 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Volume 171e5ba6-d080-4815-a5ae-a8a6251b95ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce', 'volume_size': 1} Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:43 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info" returned: 0 in 0.308s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:43 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info is being set with open permissions: ugo+rw Jul 27 13:30:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:43 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info Jul 27 13:30:43 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:44 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.info" returned: 0 in 0.274s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137009791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171e5ba6-d080-4815-a5ae-a8a6251b95ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2221c667184eac9d94c8815b395e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:43Z,use_quota=True,user_id='9c7de8ab5eca4caca2cab1b924fb2280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Creating volume 171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:44 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:44 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce 1073741824 Jul 27 13:30:44 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0bd03898-73cd-4760-8cb8-ac460f1ac6bb tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:30:44 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce 1073741824" returned: 0 in 0.501s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:44 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce Jul 27 13:30:44 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-795f6b81-1c0e-40a4-9f09-c236ddd80eba-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Lock "cinder-795f6b81-1c0e-40a4-9f09-c236ddd80eba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-36327e38-3b9d-490b-9a6e-029d785303cc" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-36327e38-3b9d-490b-9a6e-029d785303cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-795f6b81-1c0e-40a4-9f09-c236ddd80eba" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-795f6b81-1c0e-40a4-9f09-c236ddd80eba" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot 795f6b81-1c0e-40a4-9f09-c236ddd80eba of volume 36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:44 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce" returned: 0 in 0.281s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9833f0c8-2232-4629-8fa9-b83c5eb54571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a54ee95-bf6c-46ca-8bf1-5451b17147da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b69c0-e412-4b1e-a8b0-c563c7260307]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:44 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Volume volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce (171e5ba6-d080-4815-a5ae-a8a6251b95ce): created successfully Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a54ee95-bf6c-46ca-8bf1-5451b17147da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Flow 'volume_create_manager' (3182ffaf-7bc1-47f8-b25a-f51e1f20cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:44 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-645cd9fe-1755-4096-a322-93e735e3cdff tempest-ProjectReaderTests-1981262615 None] Created volume successfully. Jul 27 13:30:45 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba Jul 27 13:30:45 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:45 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba" returned: 0 in 0.389s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36327e38-3b9d-490b-9a6e-029d785303cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4c89df-57a1-45d7-94db-62f3e000bb65]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:45 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc Jul 27 13:30:45 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:45 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc" returned: 0 in 0.427s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:45 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba Jul 27 13:30:45 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Creating offline snapshot e3ae6a39-80f8-4593-a113-36065d9c652a of volume 171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[79547f9a-2774-445c-b004-cf26ea0481b8]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:45 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce Jul 27 13:30:45 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:46 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba" returned: 0 in 0.440s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:46 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba Jul 27 13:30:46 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:46 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce" returned: 0 in 0.469s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:46 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a 1G Jul 27 13:30:46 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:46 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc.795f6b81-1c0e-40a4-9f09-c236ddd80eba" returned: 0 in 0.286s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-795f6b81-1c0e-40a4-9f09-c236ddd80eba" released by "_delete_snapshot" :: held 1.684s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-36327e38-3b9d-490b-9a6e-029d785303cc" released by "delete_snapshot" :: held 1.707s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Created reservations ['4a2c711d-4706-4565-8385-03039df7f023', 'a812f738-65b4-494c-aace-5584694fbe0e', 'e8cf67d3-9f77-4582-bdf4-0f4785ca1551', 'c82aa04e-f4ed-49e4-a026-b93b6900bfc7'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:46 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d0031572-ef14-401a-80da-c5efc7e7fe00 tempest-ProjectMemberTests-702518941 None] Lock "cinder-795f6b81-1c0e-40a4-9f09-c236ddd80eba-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:46 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a 1G" returned: 0 in 0.505s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:46 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a Jul 27 13:30:46 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-36327e38-3b9d-490b-9a6e-029d785303cc-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:46 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Lock "cinder-36327e38-3b9d-490b-9a6e-029d785303cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-36327e38-3b9d-490b-9a6e-029d785303cc" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-36327e38-3b9d-490b-9a6e-029d785303cc" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e5621b-8817-481c-9fc5-7c8e4b6e6699]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:47 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:47 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a is being set with open permissions: ugo+rw Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:47 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a Jul 27 13:30:47 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:47 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc Jul 27 13:30:47 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:47 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:47 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info Jul 27 13:30:47 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:47 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:47 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc Jul 27 13:30:47 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:47 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:47 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info is being set with open permissions: ugo+rw Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:47 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info Jul 27 13:30:47 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:47 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-36327e38-3b9d-490b-9a6e-029d785303cc" returned: 0 in 0.279s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-36327e38-3b9d-490b-9a6e-029d785303cc" released by "delete_volume" :: held 0.752s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:47 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Created reservations ['c150202d-a158-4e95-b5d0-38cfd9e8e118', '8c30caa1-b80d-44fc-acee-a4c13b6cc3b5', '5e397b48-5bec-4540-89af-471d4304b108', '401e0c46-8666-459c-88c6-fcfcb318d934'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:48 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.info" returned: 0 in 0.344s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-6ab8d4c9-d39b-4611-832c-5f061879db12 tempest-ProjectReaderTests-1981262615 None] Create snapshot completed successfully Jul 27 13:30:48 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:48 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:48 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.280s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:48 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-af2ca0c5-060f-473c-bfdf-e65926249a19 tempest-ProjectMemberTests-702518941 None] Lock "cinder-36327e38-3b9d-490b-9a6e-029d785303cc-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (d181523f-8ffc-490a-bfc0-03a733adc78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ccc97f-1efc-4a9e-b4da-9fffc05bc4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ccc97f-1efc-4a9e-b4da-9fffc05bc4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694630204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2a778e-3759-4279-bf47-63e1e63076cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:49Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac614b1-1e78-4dc4-8b2d-3e272348ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac614b1-1e78-4dc4-8b2d-3e272348ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e51f38-93fd-4b32-95cd-1c9e40e1ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e51f38-93fd-4b32-95cd-1c9e40e1ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2a778e-3759-4279-bf47-63e1e63076cf', 'volume_name': 'volume-9f2a778e-3759-4279-bf47-63e1e63076cf', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c113c0-94a8-4862-ae19-573193ebe38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c113c0-94a8-4862-ae19-573193ebe38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89181827-8440-4970-9187-9e2b399ef47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:48 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Volume 9f2a778e-3759-4279-bf47-63e1e63076cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2a778e-3759-4279-bf47-63e1e63076cf', 'volume_size': 1} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694630204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2a778e-3759-4279-bf47-63e1e63076cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:49Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Creating volume 9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:48 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf 1073741824 Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:48 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:48 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-e3ae6a39-80f8-4593-a113-36065d9c652a-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-e3ae6a39-80f8-4593-a113-36065d9c652a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-171e5ba6-d080-4815-a5ae-a8a6251b95ce" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-171e5ba6-d080-4815-a5ae-a8a6251b95ce" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-e3ae6a39-80f8-4593-a113-36065d9c652a" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-e3ae6a39-80f8-4593-a113-36065d9c652a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Deleting offline snapshot e3ae6a39-80f8-4593-a113-36065d9c652a of volume 171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] snapshot_file for this snap is: volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae411e-22fc-4021-8af7-eb870e821bcf]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:49 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a Jul 27 13:30:49 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:49 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf 1073741824" returned: 0 in 0.531s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:49 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf Jul 27 13:30:49 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:49 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a" returned: 0 in 0.428s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd614bb-8245-4a76-8cf0-a235509daf3e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:49 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89181827-8440-4970-9187-9e2b399ef47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2a778e-3759-4279-bf47-63e1e63076cf', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8845aca2-17e7-4a24-bc96-28f56947551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:49 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce Jul 27 13:30:49 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:49 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Volume volume-9f2a778e-3759-4279-bf47-63e1e63076cf (9f2a778e-3759-4279-bf47-63e1e63076cf): created successfully Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8845aca2-17e7-4a24-bc96-28f56947551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (d181523f-8ffc-490a-bfc0-03a733adc78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:49 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8a057d38-0df3-4f90-886a-36df75f5d6ee tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:30:49 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce" returned: 0 in 0.361s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:49 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a Jul 27 13:30:49 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:50 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a" returned: 0 in 0.333s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:50 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a Jul 27 13:30:50 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:50 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce.e3ae6a39-80f8-4593-a113-36065d9c652a" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-e3ae6a39-80f8-4593-a113-36065d9c652a" released by "_delete_snapshot" :: held 1.485s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-171e5ba6-d080-4815-a5ae-a8a6251b95ce" released by "delete_snapshot" :: held 1.519s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Created reservations ['22695f6c-f311-41cd-92ec-df1ed8289dd7', 'aabf457c-d3d2-4467-825a-9915839f73f0', '9ec5f466-6955-434d-98c1-af111e15e319', 'a8446dd8-10cd-44f3-b32d-c289801772ab'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Delete snapshot completed successfully. Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-bb1b3c35-66bc-4cb7-a5c5-24f643b56770 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-e3ae6a39-80f8-4593-a113-36065d9c652a-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Creating offline snapshot 6dfaeb6a-c4f3-491e-81de-2e04cd5444da of volume 9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1606f30c-ae43-4819-8e48-f3f438772f62]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:51 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf Jul 27 13:30:51 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-171e5ba6-d080-4815-a5ae-a8a6251b95ce-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-171e5ba6-d080-4815-a5ae-a8a6251b95ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "cinder-quobyte-171e5ba6-d080-4815-a5ae-a8a6251b95ce" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-171e5ba6-d080-4815-a5ae-a8a6251b95ce" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e002ae2-5589-4d97-8e3a-5dd92986bc71]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:51 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf" returned: 0 in 0.379s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:51 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da 1G Jul 27 13:30:51 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:51 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce Jul 27 13:30:51 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:51 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce" returned: 0 in 0.367s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:51 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce Jul 27 13:30:51 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:51 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da 1G" returned: 0 in 0.400s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2a778e-3759-4279-bf47-63e1e63076cf -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:51 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2a778e-3759-4279-bf47-63e1e63076cf -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da Jul 27 13:30:51 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:51 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-171e5ba6-d080-4815-a5ae-a8a6251b95ce" returned: 0 in 0.250s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-quobyte-171e5ba6-d080-4815-a5ae-a8a6251b95ce" released by "delete_volume" :: held 0.680s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:51 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Created reservations ['5afc91e5-6d1c-40e5-940c-ef223538d105', '030bd250-6b39-4a40-83a0-d329612481bd', '8d2f2aa5-9b1c-469a-9d10-2d18b90d64f6', 'cac6c280-00c3-4eda-847d-1bc5fd09e9e8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:52 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2a778e-3759-4279-bf47-63e1e63076cf -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da" returned: 0 in 0.319s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:52 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da is being set with open permissions: ugo+rw Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:52 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da Jul 27 13:30:52 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:52 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:52 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:52 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da" returned: 0 in 0.259s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:52 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.273s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Deleted volume successfully. Jul 27 13:30:52 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info Jul 27 13:30:52 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5004bc8f-047e-4de3-927a-c3779d2fab00 tempest-ProjectReaderTests-1981262615 None] Lock "cinder-171e5ba6-d080-4815-a5ae-a8a6251b95ce-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:52 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:52 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info is being set with open permissions: ugo+rw Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:52 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info Jul 27 13:30:52 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:52 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.info" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-3f286926-fa8f-4d33-85d3-1ee7c5fbacf4 tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-6dfaeb6a-c4f3-491e-81de-2e04cd5444da-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Lock "cinder-6dfaeb6a-c4f3-491e-81de-2e04cd5444da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-9f2a778e-3759-4279-bf47-63e1e63076cf" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-9f2a778e-3759-4279-bf47-63e1e63076cf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-6dfaeb6a-c4f3-491e-81de-2e04cd5444da" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-6dfaeb6a-c4f3-491e-81de-2e04cd5444da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot 6dfaeb6a-c4f3-491e-81de-2e04cd5444da of volume 9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[00575b17-ec8f-4990-8e5b-0d4af2c975aa]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:53 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da Jul 27 13:30:53 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:53 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da" returned: 0 in 0.403s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f2a778e-3759-4279-bf47-63e1e63076cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcca270-be62-4c34-91f4-a40141eb5156]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:53 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf Jul 27 13:30:53 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:53 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf" returned: 0 in 0.381s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:53 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da Jul 27 13:30:53 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:54 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da" returned: 0 in 0.347s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:54 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da Jul 27 13:30:54 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:54 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf.6dfaeb6a-c4f3-491e-81de-2e04cd5444da" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-6dfaeb6a-c4f3-491e-81de-2e04cd5444da" released by "_delete_snapshot" :: held 1.498s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-9f2a778e-3759-4279-bf47-63e1e63076cf" released by "delete_snapshot" :: held 1.522s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Created reservations ['5014fbdd-5d7d-4ecd-826b-9ae2555c6b7a', 'ed33b211-a87e-47cf-9eee-8bad45c7cf6a', '1361d415-a597-4193-9d3b-aed9e6f52165', '589e958f-61d9-445f-ac73-b9eeca4f704f'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:54 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:30:54 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-8ce666a7-336c-40b6-b8e1-561ec8dd5bbb tempest-ProjectMemberTests-702518941 None] Lock "cinder-6dfaeb6a-c4f3-491e-81de-2e04cd5444da-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-9f2a778e-3759-4279-bf47-63e1e63076cf-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-9f2a778e-3759-4279-bf47-63e1e63076cf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-9f2a778e-3759-4279-bf47-63e1e63076cf" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-9f2a778e-3759-4279-bf47-63e1e63076cf" acquired by "delete_volume" :: waited 0.024s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2e36b7-7d15-4919-bfba-4891a6e57c75]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:55 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf Jul 27 13:30:55 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:55 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf" returned: 0 in 0.389s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:55 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf Jul 27 13:30:55 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:56 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-9f2a778e-3759-4279-bf47-63e1e63076cf" returned: 0 in 0.275s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-9f2a778e-3759-4279-bf47-63e1e63076cf" released by "delete_volume" :: held 0.728s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Created reservations ['a4b9aedc-e996-4bd5-aad5-b7ea4f3ee128', '0117ba8e-af70-4d77-91f8-3507dfd0ed10', 'a00a75b8-021d-417c-bc9f-91251dfa4560', 'f717b882-a7ef-459f-aacc-4dfc4be7aaa7'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:56 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:30:56 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:56 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.252s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:30:56 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-5c0b2ca9-afb0-4940-9171-a42560abe0d1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-9f2a778e-3759-4279-bf47-63e1e63076cf-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (f65a5b0f-26b5-429e-8b31-786785730a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e4d8ab-58ed-42fa-96aa-f9402ef55f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e4d8ab-58ed-42fa-96aa-f9402ef55f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145310442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f81643b-11af-4c1d-9625-5f523675b6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:57Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3e419c-3fdc-487e-8775-4f80c5a18268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3e419c-3fdc-487e-8775-4f80c5a18268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1baf478-e286-4ba4-8ae2-d28f914db96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1baf478-e286-4ba4-8ae2-d28f914db96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f81643b-11af-4c1d-9625-5f523675b6f3', 'volume_name': 'volume-5f81643b-11af-4c1d-9625-5f523675b6f3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f9d099-157a-4c7a-9978-237a006a0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f9d099-157a-4c7a-9978-237a006a0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6336de53-c7bb-4d8b-8c49-d3df5429f9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:56 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Volume 5f81643b-11af-4c1d-9625-5f523675b6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f81643b-11af-4c1d-9625-5f523675b6f3', 'volume_size': 1} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145310442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f81643b-11af-4c1d-9625-5f523675b6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:30:57Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Creating volume 5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:30:56 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:30:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:56 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 1073741824 Jul 27 13:30:56 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:57 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 1073741824" returned: 0 in 0.445s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:57 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 Jul 27 13:30:57 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:57 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3" returned: 0 in 0.277s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6336de53-c7bb-4d8b-8c49-d3df5429f9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f81643b-11af-4c1d-9625-5f523675b6f3', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704b24cb-fa0a-4ea8-b57e-517da649b8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:30:57 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Volume volume-5f81643b-11af-4c1d-9625-5f523675b6f3 (5f81643b-11af-4c1d-9625-5f523675b6f3): created successfully Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704b24cb-fa0a-4ea8-b57e-517da649b8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:30:57 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (f65a5b0f-26b5-429e-8b31-786785730a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:30:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-77117188-4923-414a-a356-faf3cd2e6e3a tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Creating offline snapshot e4837fa4-4077-498d-9b76-5823060ac8a9 of volume 5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5469b1f-f58d-4381-ac47-ef4a9c0cf1dc]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:58 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 Jul 27 13:30:58 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:58 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3" returned: 0 in 0.361s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:58 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 1G Jul 27 13:30:58 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:58 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 1G" returned: 0 in 0.396s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f81643b-11af-4c1d-9625-5f523675b6f3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:58 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f81643b-11af-4c1d-9625-5f523675b6f3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 Jul 27 13:30:58 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:59 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f81643b-11af-4c1d-9625-5f523675b6f3 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9" returned: 0 in 0.292s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:59 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 is being set with open permissions: ugo+rw Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:59 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 Jul 27 13:30:59 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:59 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:59 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info Jul 27 13:30:59 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:59 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info" returned: 0 in 0.269s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:59 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info is being set with open permissions: ugo+rw Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:30:59 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info Jul 27 13:30:59 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:30:59 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.info" returned: 0 in 0.263s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:30:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:30:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-8a36212b-1ce2-4092-8490-780b1d6dc872 tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-e4837fa4-4077-498d-9b76-5823060ac8a9-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Lock "cinder-e4837fa4-4077-498d-9b76-5823060ac8a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-5f81643b-11af-4c1d-9625-5f523675b6f3" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-5f81643b-11af-4c1d-9625-5f523675b6f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-e4837fa4-4077-498d-9b76-5823060ac8a9" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-e4837fa4-4077-498d-9b76-5823060ac8a9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot e4837fa4-4077-498d-9b76-5823060ac8a9 of volume 5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e115db43-524d-4ade-8d2a-c6eca2564452]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:00 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 Jul 27 13:31:00 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:00 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f81643b-11af-4c1d-9625-5f523675b6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a9b83-192b-4464-bc63-a663ef09cd9b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:00 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:00 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 Jul 27 13:31:00 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:01 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3" returned: 0 in 0.393s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:01 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 Jul 27 13:31:01 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:01 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9" returned: 0 in 0.353s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:01 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9 Jul 27 13:31:01 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:01 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3.e4837fa4-4077-498d-9b76-5823060ac8a9" returned: 0 in 0.254s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-e4837fa4-4077-498d-9b76-5823060ac8a9" released by "_delete_snapshot" :: held 1.500s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-5f81643b-11af-4c1d-9625-5f523675b6f3" released by "delete_snapshot" :: held 1.530s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Created reservations ['c977a1f8-7297-4c06-9c25-2b983e6f81ab', 'd43bebbe-39b6-4072-9924-f3d5cfcd0472', 'ca594294-7bdd-46c6-8092-f567b9727ecf', '25fea19d-6368-41b6-8c0d-62d52fef5220'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:01 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:01 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c8842a8-ab5a-4881-84bc-d3f3416aa360 tempest-ProjectMemberTests-702518941 None] Lock "cinder-e4837fa4-4077-498d-9b76-5823060ac8a9-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-5f81643b-11af-4c1d-9625-5f523675b6f3-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Lock "cinder-5f81643b-11af-4c1d-9625-5f523675b6f3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-5f81643b-11af-4c1d-9625-5f523675b6f3" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-5f81643b-11af-4c1d-9625-5f523675b6f3" acquired by "delete_volume" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3612838-d5a8-447c-b598-3cadfff50409]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:02 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 Jul 27 13:31:02 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:02 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3" returned: 0 in 0.396s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:02 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:02 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3 Jul 27 13:31:02 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:03 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-5f81643b-11af-4c1d-9625-5f523675b6f3" returned: 0 in 0.279s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-5f81643b-11af-4c1d-9625-5f523675b6f3" released by "delete_volume" :: held 0.737s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Created reservations ['7c428e5d-f5a1-418d-8778-497d38b8b631', 'f6ff02d1-790b-492f-9a9d-be10e6c4332d', '7b748d34-6a68-4253-bb13-55a7ee44bb42', '81ccbd30-fa87-41e1-8b3e-f743650f2823'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:03 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:03 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:03 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.270s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:03 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:03 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4c5b1134-5ea8-4a1c-99b3-d967c6cba53c tempest-ProjectMemberTests-702518941 None] Lock "cinder-5f81643b-11af-4c1d-9625-5f523675b6f3-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (fead2672-b470-4524-8f3b-4de19dbb5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee208073-672f-462f-b3f3-13a3459a6c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee208073-672f-462f-b3f3-13a3459a6c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681275787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:04Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75194ec8-dd36-4d65-8ac8-8aededc860ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75194ec8-dd36-4d65-8ac8-8aededc860ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3877d3-2a7d-438e-8ef8-27f61a3ece08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3877d3-2a7d-438e-8ef8-27f61a3ece08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de', 'volume_name': 'volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1e80de-8624-4439-a2e1-bce689c64a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1e80de-8624-4439-a2e1-bce689c64a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d43a69c-87eb-4fdc-95b6-cf31b54780eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Volume ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de', 'volume_size': 1} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681275787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:04Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Creating volume ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:04 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:04 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de 1073741824 Jul 27 13:31:04 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:04 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de 1073741824" returned: 0 in 0.463s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:04 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de Jul 27 13:31:04 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:04 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" returned: 0 in 0.253s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d43a69c-87eb-4fdc-95b6-cf31b54780eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12426592-f9cc-4375-805c-0d588f57b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:04 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Volume volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de (ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de): created successfully Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12426592-f9cc-4375-805c-0d588f57b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:04 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (fead2672-b470-4524-8f3b-4de19dbb5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:04 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-81d2167c-e0ba-49f1-87d3-cb448fa4e76d tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Creating offline snapshot 5e56073c-ebaf-4a7e-882a-e2cf833bbd64 of volume ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42c7a2-69a9-4274-872b-56197dcf5222]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:06 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de Jul 27 13:31:06 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:06 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" returned: 0 in 0.358s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:06 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:06 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 1G Jul 27 13:31:06 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:07 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 1G" returned: 0 in 0.573s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:07 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 Jul 27 13:31:07 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:07 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64" returned: 0 in 0.324s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:07 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 is being set with open permissions: ugo+rw Jul 27 13:31:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:07 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 Jul 27 13:31:07 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:07 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:07 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:07 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info Jul 27 13:31:07 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:08 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info" returned: 0 in 0.267s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:08 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info is being set with open permissions: ugo+rw Jul 27 13:31:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:08 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info Jul 27 13:31:08 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:08 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.info" returned: 0 in 0.255s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:08 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:08 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1962ce86-4312-4e68-b734-2bd758d4953f tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-5e56073c-ebaf-4a7e-882a-e2cf833bbd64-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Lock "cinder-5e56073c-ebaf-4a7e-882a-e2cf833bbd64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-5e56073c-ebaf-4a7e-882a-e2cf833bbd64" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-5e56073c-ebaf-4a7e-882a-e2cf833bbd64" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot 5e56073c-ebaf-4a7e-882a-e2cf833bbd64 of volume ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[48986e48-4392-40ce-96ed-d5e693fc0b8a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:09 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 Jul 27 13:31:09 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:09 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7b748-326e-4526-a45e-ebf8fb2bc630]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:09 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:10 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de Jul 27 13:31:10 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:10 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:10 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 Jul 27 13:31:10 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:10 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64" returned: 0 in 0.370s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:10 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64 Jul 27 13:31:10 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:10 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:10 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de.5e56073c-ebaf-4a7e-882a-e2cf833bbd64" returned: 0 in 0.295s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-5e56073c-ebaf-4a7e-882a-e2cf833bbd64" released by "_delete_snapshot" :: held 1.549s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" released by "delete_snapshot" :: held 1.574s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Created reservations ['f06889ee-686c-4afc-9737-a399868e865e', '7dfca83b-ee8f-43aa-bf5d-b96455f82cf4', 'adae66ea-b763-4b05-bfce-915164c0a58e', '427d9039-3fd5-46d6-8908-bf722c381396'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:11 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4d260eb1-6efd-4afb-b126-2e41601bb111 tempest-ProjectMemberTests-702518941 None] Lock "cinder-5e56073c-ebaf-4a7e-882a-e2cf833bbd64-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Lock "cinder-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" acquired by "delete_volume" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8024d96e-8de1-49eb-a1c9-a4c0ade872b2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:11 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:11 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de Jul 27 13:31:11 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:12 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" returned: 0 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:12 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de Jul 27 13:31:12 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:12 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" returned: 0 in 0.269s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de" released by "delete_volume" :: held 0.713s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Created reservations ['cfa130c6-2b12-4951-9f3b-eb75c7d5cc9c', '5f253b08-71a7-4dfd-bfb7-e3feac5606b8', 'cd707a3a-8cb3-47b5-8621-e259f3a858fd', 'd529d65e-5beb-4596-b6d0-c4eece2f65d4'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:12 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:12 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:12 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.271s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:12 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:12 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7d06d143-9f0d-4502-bf44-08b24bf70164 tempest-ProjectMemberTests-702518941 None] Lock "cinder-ea34bd2c-8bf8-4902-adc1-4a1b5df4d2de-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (7d862d52-e049-4803-bc5e-be3923ecaa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6e16e6-0fc9-4d15-b6a7-aa3dfd25f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6e16e6-0fc9-4d15-b6a7-aa3dfd25f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679883841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a27289f-bd90-4a3a-9b07-a8a56d34e1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:13Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81699ce1-6606-443f-a921-d20942c323cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81699ce1-6606-443f-a921-d20942c323cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaf7682-9373-401e-ad80-242782973d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaf7682-9373-401e-ad80-242782973d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a27289f-bd90-4a3a-9b07-a8a56d34e1ed', 'volume_name': 'volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911fc42d-9ae8-412c-8f38-cfd2cc8d970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911fc42d-9ae8-412c-8f38-cfd2cc8d970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763e8945-9406-4ea2-99d5-2ad6bb351b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:13 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Volume 8a27289f-bd90-4a3a-9b07-a8a56d34e1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed', 'volume_size': 1} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679883841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a27289f-bd90-4a3a-9b07-a8a56d34e1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:13Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Creating volume 8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:13 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:13 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed 1073741824 Jul 27 13:31:13 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:13 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed 1073741824" returned: 0 in 0.513s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:13 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:13 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed Jul 27 13:31:13 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:14 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763e8945-9406-4ea2-99d5-2ad6bb351b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e192f9d-f1c7-4b90-98ec-5c06803c48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:14 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Volume volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed (8a27289f-bd90-4a3a-9b07-a8a56d34e1ed): created successfully Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e192f9d-f1c7-4b90-98ec-5c06803c48a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:14 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (7d862d52-e049-4803-bc5e-be3923ecaa93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:14 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-a04b5b31-0ecd-4b85-9dd8-4ea730f29357 tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Creating offline snapshot d99edd48-daca-41f5-9bb5-06f426dfba9a of volume 8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabf54c2-2e86-4fa7-bc8e-19d2fbc146b2]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:15 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed Jul 27 13:31:15 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:15 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" returned: 0 in 0.379s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:15 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:16 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a 1G Jul 27 13:31:16 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:16 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a 1G" returned: 0 in 0.431s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:16 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a Jul 27 13:31:16 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:16 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a" returned: 0 in 0.285s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:16 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a is being set with open permissions: ugo+rw Jul 27 13:31:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:16 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a Jul 27 13:31:16 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:16 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a" returned: 0 in 0.259s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:16 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:17 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info Jul 27 13:31:17 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:17 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info" returned: 0 in 0.278s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:17 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info is being set with open permissions: ugo+rw Jul 27 13:31:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:17 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info Jul 27 13:31:17 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:17 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.info" returned: 0 in 0.249s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:17 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:17 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-b9715fd6-46b6-4db6-8f6d-3f00a666970a tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-d99edd48-daca-41f5-9bb5-06f426dfba9a-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-d99edd48-daca-41f5-9bb5-06f426dfba9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-d99edd48-daca-41f5-9bb5-06f426dfba9a" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-d99edd48-daca-41f5-9bb5-06f426dfba9a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot d99edd48-daca-41f5-9bb5-06f426dfba9a of volume 8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ade6c-5562-4a2f-8e82-4118b98c8f21]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:18 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:18 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a Jul 27 13:31:18 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:19 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a" returned: 0 in 0.370s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f405af-96c7-4908-a024-84c1ebb5dd95]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:19 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed Jul 27 13:31:19 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:19 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" returned: 0 in 0.387s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:19 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a Jul 27 13:31:19 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:19 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a" returned: 0 in 0.377s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:19 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:19 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a Jul 27 13:31:19 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:20 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed.d99edd48-daca-41f5-9bb5-06f426dfba9a" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-d99edd48-daca-41f5-9bb5-06f426dfba9a" released by "_delete_snapshot" :: held 1.516s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" released by "delete_snapshot" :: held 1.545s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Created reservations ['94936491-d640-4a77-b98c-792fd804d4d6', '50521e90-4bf9-41b2-b0c6-5926a282f46c', '043740d9-6754-44f1-b710-e017fbbe5bde', 'd22bc87a-d415-492e-ae25-bb90315c8fb9'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:20 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-de46b791-0fff-45e6-80fe-117c4a3d0ad1 tempest-ProjectMemberTests-702518941 None] Lock "cinder-d99edd48-daca-41f5-9bb5-06f426dfba9a-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Lock "cinder-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:20 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b56c591-a374-4878-8f93-663802312b96]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:21 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed Jul 27 13:31:21 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:21 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" returned: 0 in 0.401s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:21 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed Jul 27 13:31:21 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:21 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed" released by "delete_volume" :: held 0.745s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Created reservations ['b338767f-9f6c-472a-8b30-66bc2b84f0a8', 'cf781f0e-7c6b-48f1-9ebd-886759a08566', '649af064-ceea-4ac3-afe8-e4f8b749bd30', '12832236-beb2-4633-84c5-cf85931cb9e8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:21 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:21 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:21 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:22 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.283s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:22 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-e868280c-92ab-4cbd-9b39-7ad672138a16 tempest-ProjectMemberTests-702518941 None] Lock "cinder-8a27289f-bd90-4a3a-9b07-a8a56d34e1ed-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=159,cinder:UPDATE=227,cinder:DELETE=16,cinder:INSERT=58 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=162,cinder:INSERT=57,cinder:UPDATE=199,cinder:DELETE=18 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (9bacd52e-7ef1-4a6a-8e05-9c348969ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fdc628-58cf-40a8-b7b4-7558e8118126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fdc628-58cf-40a8-b7b4-7558e8118126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-953494649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d848df-24cd-4bb7-9c8a-46fbb6dfc190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:22Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef76778f-dfd4-4a59-9b6f-7b18f035d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef76778f-dfd4-4a59-9b6f-7b18f035d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931733dd-3c5e-4769-9f91-e51c6fb01f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931733dd-3c5e-4769-9f91-e51c6fb01f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d848df-24cd-4bb7-9c8a-46fbb6dfc190', 'volume_name': 'volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bbb9f1-1e03-4858-b8c1-6d4f009f7fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bbb9f1-1e03-4858-b8c1-6d4f009f7fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1336243-1fe6-42a0-8561-a0ba47c0414c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:22 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Volume c6d848df-24cd-4bb7-9c8a-46fbb6dfc190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190', 'volume_size': 1} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-953494649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d848df-24cd-4bb7-9c8a-46fbb6dfc190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:22Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Creating volume c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:22 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:22 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:22 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 1073741824 Jul 27 13:31:22 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:23 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 1073741824" returned: 0 in 0.497s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:23 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 Jul 27 13:31:23 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:23 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1336243-1fe6-42a0-8561-a0ba47c0414c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685b7c18-b886-461e-a527-6f322b81f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:23 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Volume volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 (c6d848df-24cd-4bb7-9c8a-46fbb6dfc190): created successfully Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685b7c18-b886-461e-a527-6f322b81f243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:23 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (9bacd52e-7ef1-4a6a-8e05-9c348969ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:23 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-23e88191-6820-4666-92a1-385f1542aa95 tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:31:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:24 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Creating offline snapshot 465e4ad6-75c3-41bc-b9b8-3f147141c00b of volume c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:24 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb80549a-840e-4292-85e9-863d1a5244d1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:24 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:24 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 Jul 27 13:31:24 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:25 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" returned: 0 in 0.404s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:25 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b 1G Jul 27 13:31:25 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Flow 'volume_create_manager' (a527e34e-91bd-4472-be2a-4e7316f96f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970a67c7-917f-47b4-a425-542c7702f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970a67c7-917f-47b4-a425-542c7702f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2040030734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c225f274-db81-4e6b-80ee-3f0ba48a8e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afef7e828a904c9e882e94205e13041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:25Z,use_quota=True,user_id='964876ec377a429bbd5293bfb89a8461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596d3081-6aca-48c6-9d6e-d4ec6514b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596d3081-6aca-48c6-9d6e-d4ec6514b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64b6aa6-d3d2-41f5-a078-014a275e402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64b6aa6-d3d2-41f5-a078-014a275e402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c225f274-db81-4e6b-80ee-3f0ba48a8e83', 'volume_name': 'volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f68f59-655e-42c3-9690-0a72b917fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f68f59-655e-42c3-9690-0a72b917fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e494a5-3deb-4547-8663-2ec9c2c78d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:25 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Volume c225f274-db81-4e6b-80ee-3f0ba48a8e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83', 'volume_size': 1} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:25 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b 1G" returned: 0 in 0.391s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:25 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b Jul 27 13:31:25 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:25 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b" returned: 0 in 0.290s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:25 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b is being set with open permissions: ugo+rw Jul 27 13:31:25 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:25 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b Jul 27 13:31:25 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:26 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b" returned: 0 in 0.238s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:26 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info Jul 27 13:31:26 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:26 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info" returned: 0 in 0.246s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:26 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info is being set with open permissions: ugo+rw Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:26 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info Jul 27 13:31:26 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:26 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.info" returned: 0 in 0.240s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2040030734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c225f274-db81-4e6b-80ee-3f0ba48a8e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afef7e828a904c9e882e94205e13041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:25Z,use_quota=True,user_id='964876ec377a429bbd5293bfb89a8461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Creating volume c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:26 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:26 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 1073741824 Jul 27 13:31:26 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:26 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-0dac931e-6cc8-4ddc-8992-5458ea28b0aa tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-465e4ad6-75c3-41bc-b9b8-3f147141c00b-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Lock "cinder-465e4ad6-75c3-41bc-b9b8-3f147141c00b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-465e4ad6-75c3-41bc-b9b8-3f147141c00b" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-465e4ad6-75c3-41bc-b9b8-3f147141c00b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:26 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot 465e4ad6-75c3-41bc-b9b8-3f147141c00b of volume c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f13e6-377a-4c8b-b7a1-1a7af7280b37]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:27 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b Jul 27 13:31:27 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:27 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 1073741824" returned: 0 in 0.461s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:27 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:27 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:27 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b59ec90-6bf1-4f2f-b2a6-478c2edf49fd]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:27 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.247s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e494a5-3deb-4547-8663-2ec9c2c78d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab5e814-e9dc-4218-8b6b-e97ed237cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:27 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Volume volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 (c225f274-db81-4e6b-80ee-3f0ba48a8e83): created successfully Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab5e814-e9dc-4218-8b6b-e97ed237cab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Flow 'volume_create_manager' (a527e34e-91bd-4472-be2a-4e7316f96f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:27 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-32eaa7ad-8a60-47bf-b624-557fbedde596 tempest-SnapshotDependencyTests-137361234 None] Created volume successfully. Jul 27 13:31:27 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 Jul 27 13:31:27 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:27 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" returned: 0 in 0.346s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:27 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:27 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b Jul 27 13:31:27 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:28 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b" returned: 0 in 0.328s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:28 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b Jul 27 13:31:28 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:28 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190.465e4ad6-75c3-41bc-b9b8-3f147141c00b" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-465e4ad6-75c3-41bc-b9b8-3f147141c00b" released by "_delete_snapshot" :: held 1.390s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" released by "delete_snapshot" :: held 1.413s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Created reservations ['28f637fd-32c0-4fa9-b395-c960ec0a92e3', 'dcc777e6-8f9a-4cd2-853d-98c912aa4523', '99fe129b-4f8f-47fb-806b-51aad5bbe155', '745cd0d9-2394-4ca1-803c-ce6019a563c8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:28 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7b4ed105-1809-4343-9caa-beadfe27e843 tempest-ProjectMemberTests-702518941 None] Lock "cinder-465e4ad6-75c3-41bc-b9b8-3f147141c00b-delete_snapshot" released by "delete_snapshot" :: held 1.550s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Creating offline snapshot 729d17f4-f087-49a0-8081-08663a20ca9e of volume c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[599304c1-df9b-4270-b306-3068b8ac82a7]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:28 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:28 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:28 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:29 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.380s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:29 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e 1G Jul 27 13:31:29 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Lock "cinder-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff52d72-3243-4ecb-a027-f022d3e02981]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:29 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 Jul 27 13:31:29 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:29 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e 1G" returned: 0 in 0.399s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:29 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e Jul 27 13:31:29 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:29 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:29 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190 Jul 27 13:31:29 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:29 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e" returned: 0 in 0.313s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:29 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e is being set with open permissions: ugo+rw Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:29 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e Jul 27 13:31:29 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:29 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" returned: 0 in 0.265s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190" released by "delete_volume" :: held 0.704s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:29 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Created reservations ['3e4904f4-9d19-4adc-9072-304926384800', '7eaa4c51-5575-4b33-9f1c-3b6bc7bd5a2e', '378c3100-76d7-4ff6-ab32-d5e004046022', 'a5926c5a-c461-4ac3-9681-6152e6bf93a2'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:30 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:30 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:30 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e" returned: 0 in 0.262s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:30 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info Jul 27 13:31:30 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:30 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.257s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-630d06c0-6aa9-43fd-b0cc-c433bb7e78ed tempest-ProjectMemberTests-702518941 None] Lock "cinder-c6d848df-24cd-4bb7-9c8a-46fbb6dfc190-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:30 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:30 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info is being set with open permissions: ugo+rw Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:30 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info Jul 27 13:31:30 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:30 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.info" returned: 0 in 0.252s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:30 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-23328dba-730e-4c91-b64f-3915bd8378f0 tempest-SnapshotDependencyTests-137361234 None] Create snapshot completed successfully Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (ab006e6b-5f2a-48c8-9667-ce5e6c2d7d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c694ba5-468a-4dce-8811-1efcab6ede53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c694ba5-468a-4dce-8811-1efcab6ede53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069185991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:31Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9307b5-2d56-42ae-b125-63256d3a0eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9307b5-2d56-42ae-b125-63256d3a0eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc61f523-6d3e-401e-9bfa-d9035ee956f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc61f523-6d3e-401e-9bfa-d9035ee956f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6', 'volume_name': 'volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a77d8a8-8684-4850-a5a4-b3bfe706080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a77d8a8-8684-4850-a5a4-b3bfe706080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0757b8f2-ad34-40b2-8239-bd479f92dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:30 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Volume 3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6', 'volume_size': 1} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069185991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:31Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Creating volume 3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:30 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:30 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:30 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 1073741824 Jul 27 13:31:30 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:31 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 1073741824" returned: 0 in 0.491s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:31 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 Jul 27 13:31:31 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Flow 'volume_create_manager' (9ac52447-6031-4302-bc02-7e3bdf29f064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3a2617-3686-49dd-9caa-cb6e6c3d0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3a2617-3686-49dd-9caa-cb6e6c3d0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afef7e828a904c9e882e94205e13041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=729d17f4-f087-49a0-8081-08663a20ca9e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:31Z,use_quota=True,user_id='964876ec377a429bbd5293bfb89a8461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57584b23-680d-47c5-be25-ded4434af26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57584b23-680d-47c5-be25-ded4434af26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2740beb-2383-4d2f-afea-1274d218eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2740beb-2383-4d2f-afea-1274d218eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad', 'volume_name': 'volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad', 'volume_size': 1, 'snapshot_id': '729d17f4-f087-49a0-8081-08663a20ca9e'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b200fb3e-b27c-402e-81fa-c12b97cfd3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b200fb3e-b27c-402e-81fa-c12b97cfd3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f13ee4-5360-42f9-8de8-c52ade12d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Volume b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad', 'volume_size': 1, 'snapshot_id': '729d17f4-f087-49a0-8081-08663a20ca9e'} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:31 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" returned: 0 in 0.244s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.105s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-quobyte-729d17f4-f087-49a0-8081-08663a20ca9e-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" by "_create_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0757b8f2-ad34-40b2-8239-bd479f92dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418d1029-48aa-4585-85a2-74e83b22eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-729d17f4-f087-49a0-8081-08663a20ca9e-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Creating volume b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad from snapshot 729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-quobyte-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" by "_copy_volume_from_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:31 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Volume volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 (3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6): created successfully Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418d1029-48aa-4585-85a2-74e83b22eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (ab006e6b-5f2a-48c8-9667-ce5e6c2d7d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] snapshot: 729d17f4-f087-49a0-8081-08663a20ca9e, volume: b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad, {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 27 13:31:31 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2bda3a28-a4fd-4a0a-8c24-71ec93dae353 tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4dbc9b-6173-4a99-988f-c5e2f6aacf43]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:31 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:31 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e Jul 27 13:31:31 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:32 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e" returned: 0 in 0.362s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Creating direct copy from snapshot {{(pid=88202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb26ab7-d34e-41ce-bb42-b8702c93b196]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:32 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:32 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:32 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.345s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG cinder.utils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Path /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad not found in is_blk_device check {{(pid=88202) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 27 13:31:32 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:32 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad Jul 27 13:31:32 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:33 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:33 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:33 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.844s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG oslo_service.periodic_task [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] Running periodic task VolumeManager._thread_info {{(pid=88202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread count: 28 {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 27 13:31:33 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-584872d9-b6ca-4a81-a98e-5b5f355c280c None None] thread info: [<_MainThread(MainThread, started 130767454662784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 27 13:31:36 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" returned: 0 in 4.521s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:36 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9f08a-1e55-4a7e-bf3b-9a554426fc06]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:36 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:37 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:37 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:37 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.518s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.image.image_utils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Image conversion details: src /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad {{(pid=88202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 27 13:31:37 devstack cinder-volume[88202]: INFO cinder.image.image_utils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Converted 1024.00 MB image at 226.44 MB/s Jul 27 13:31:37 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad is being set with open permissions: ugo+rw Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:37 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad Jul 27 13:31:37 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:37 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" returned: 0 in 0.241s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" released by "_copy_volume_from_snapshot" :: held 6.079s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-729d17f4-f087-49a0-8081-08663a20ca9e-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" released by "_create_volume_from_snapshot" :: held 6.121s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.148s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.665s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Creating offline snapshot 64d10315-d490-4f24-8568-52ee6a647425 of volume 3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f13ee4-5360-42f9-8de8-c52ade12d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad', 'volume_size': 1, 'snapshot_id': '729d17f4-f087-49a0-8081-08663a20ca9e'}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a56024-0c19-4d0d-a9b7-bd62ab04b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[706ec59d-96e9-447f-8ee2-2666965c8071]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:37 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Volume volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad (b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad): created successfully Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a56024-0c19-4d0d-a9b7-bd62ab04b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Flow 'volume_create_manager' (9ac52447-6031-4302-bc02-7e3bdf29f064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:37 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-4674bcd1-b50c-4f2c-b044-6bf47350225f tempest-SnapshotDependencyTests-137361234 None] Created volume successfully. Jul 27 13:31:37 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 Jul 27 13:31:37 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:37 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-729d17f4-f087-49a0-8081-08663a20ca9e-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-729d17f4-f087-49a0-8081-08663a20ca9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-quobyte-c225f274-db81-4e6b-80ee-3f0ba48a8e83" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-c225f274-db81-4e6b-80ee-3f0ba48a8e83" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-quobyte-729d17f4-f087-49a0-8081-08663a20ca9e" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-729d17f4-f087-49a0-8081-08663a20ca9e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Deleting offline snapshot 729d17f4-f087-49a0-8081-08663a20ca9e of volume c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] snapshot_file for this snap is: volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa61ec1f-3a98-4194-bbd5-649b7515bd82]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:38 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" returned: 0 in 0.378s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:38 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e Jul 27 13:31:38 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:38 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 1G Jul 27 13:31:38 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:38 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e" returned: 0 in 0.369s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce891d67-acfb-48db-a003-aeaa16c4755b]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:38 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 1G" returned: 0 in 0.392s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:38 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:38 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:38 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 Jul 27 13:31:38 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:38 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.360s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:38 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425" returned: 0 in 0.291s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:38 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 is being set with open permissions: ugo+rw Jul 27 13:31:38 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:38 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e Jul 27 13:31:38 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:38 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 Jul 27 13:31:38 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:39 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425" returned: 0 in 0.248s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:39 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info Jul 27 13:31:39 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:39 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e" returned: 0 in 0.359s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:39 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e Jul 27 13:31:39 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:39 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:39 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info is being set with open permissions: ugo+rw Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:39 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info Jul 27 13:31:39 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:39 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83.729d17f4-f087-49a0-8081-08663a20ca9e" returned: 0 in 0.251s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-729d17f4-f087-49a0-8081-08663a20ca9e" released by "_delete_snapshot" :: held 1.439s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-c225f274-db81-4e6b-80ee-3f0ba48a8e83" released by "delete_snapshot" :: held 1.463s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Created reservations ['29e392af-1ce9-4e53-b8dc-e08cab166574', '57c36576-703a-4c39-bd03-1c0e27072a29', 'b787ffd1-92fd-4006-9f8f-0beba75920ce', '2432fe7c-a5f4-47cb-ba37-c751bb55aff2'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Delete snapshot completed successfully. Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-53194cb5-2226-4745-b4b8-d234ef387178 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-729d17f4-f087-49a0-8081-08663a20ca9e-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:39 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.info" returned: 0 in 0.246s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:39 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:39 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-c6a61e77-18fe-4231-9415-dea426549c8e tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-c225f274-db81-4e6b-80ee-3f0ba48a8e83-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-c225f274-db81-4e6b-80ee-3f0ba48a8e83-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-quobyte-c225f274-db81-4e6b-80ee-3f0ba48a8e83" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-c225f274-db81-4e6b-80ee-3f0ba48a8e83" acquired by "delete_volume" :: waited 0.014s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c96627-a097-4d89-89ae-795c4a248c1c]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:40 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:40 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-64d10315-d490-4f24-8568-52ee6a647425-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Lock "cinder-64d10315-d490-4f24-8568-52ee6a647425-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-64d10315-d490-4f24-8568-52ee6a647425" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-64d10315-d490-4f24-8568-52ee6a647425" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot 64d10315-d490-4f24-8568-52ee6a647425 of volume 3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[989481df-5a75-4d3e-af85-60f7d912f5a6]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:40 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:40 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 Jul 27 13:31:40 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:40 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83 Jul 27 13:31:40 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:40 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-c225f274-db81-4e6b-80ee-3f0ba48a8e83" returned: 0 in 0.243s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-c225f274-db81-4e6b-80ee-3f0ba48a8e83" released by "delete_volume" :: held 0.677s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:40 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425" returned: 0 in 0.385s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bbdd68-93e3-4255-8b15-5c5b273c0ff9]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:40 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Created reservations ['4cba63a3-c096-42a4-81bb-090d3efd7598', 'b27a74ac-f8c6-45cc-a109-a787554f221f', 'e8126f54-1186-4f9c-a650-bc4b00f276ab', 'ce1f3524-2dd1-407f-9152-aaeedf606be8'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:41 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 Jul 27 13:31:41 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:41 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:41 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:41 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:41 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:41 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Deleted volume successfully. Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" returned: 0 in 0.384s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:41 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 Jul 27 13:31:41 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-434da07e-b5a9-497c-8176-3db13023ec68 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-c225f274-db81-4e6b-80ee-3f0ba48a8e83-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "cinder-quobyte-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" acquired by "delete_volume" :: waited 0.017s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e465ec9-7b5f-4356-a29c-32a445d537f1]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:41 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad Jul 27 13:31:41 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:41 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425" returned: 0 in 0.365s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:41 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425 Jul 27 13:31:41 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:41 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" returned: 0 in 0.382s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:41 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad Jul 27 13:31:41 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:41 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6.64d10315-d490-4f24-8568-52ee6a647425" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-64d10315-d490-4f24-8568-52ee6a647425" released by "_delete_snapshot" :: held 1.491s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:41 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" released by "delete_snapshot" :: held 1.515s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Created reservations ['4b63c1ba-3fd8-4e0d-acd6-bc1da0e440bd', '249e1fe2-d178-4122-a86a-22b3e4cfdccd', '11dcb794-4f95-4082-98c7-5cd14c384f84', '790f4ae1-2a4b-455e-be39-3e8a0c772726'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:42 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" returned: 0 in 0.264s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-quobyte-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad" released by "delete_volume" :: held 0.692s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-01d46c48-677c-4ae9-b493-f9d66019190f tempest-ProjectMemberTests-702518941 None] Lock "cinder-64d10315-d490-4f24-8568-52ee6a647425-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Created reservations ['6c973bcc-8cd7-4c2b-9d24-9453be7325e7', '3dee22f4-bff6-4b5c-aa7f-a160fece6b26', 'f9ababdd-26b6-4e6f-b56a-3ee7ddf4f8a3', '1a7de918-580c-45b4-b614-13a5a2d3b692'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:42 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:42 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:42 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.266s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:42 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Deleted volume successfully. Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-cc37cb6c-bdcc-4642-aea0-7f6b37929f85 tempest-SnapshotDependencyTests-137361234 None] Lock "cinder-b2ec9b0f-8c4e-4f11-98b5-0c25192ca2ad-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Lock "cinder-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" acquired by "delete_volume" :: waited 0.023s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfaece9-c1ab-4043-bf00-81ef4e863720]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:42 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:42 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 Jul 27 13:31:42 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:43 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" returned: 0 in 0.373s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:43 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6 Jul 27 13:31:43 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:43 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" returned: 0 in 0.317s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6" released by "delete_volume" :: held 0.749s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Created reservations ['33e51240-f16f-4236-b321-38397a24a87e', '6769599f-2eb5-4b22-8753-e63ee27c9198', '7c916453-045f-413c-a0d2-232849c33ae9', '47315c93-1763-4092-9e87-333570e4b33d'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:43 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:43 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:43 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.281s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:43 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:43 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-d8573b59-ebef-41a5-afbc-84439c7621f0 tempest-ProjectMemberTests-702518941 None] Lock "cinder-3644f6ff-1fa6-4cb4-a6ea-6f3bf0ed17d6-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (c92ca946-59c7-4809-b771-24c9cde86f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26929b20-dc09-40b6-9f3b-a3a66f480d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26929b20-dc09-40b6-9f3b-a3a66f480d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-212645301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a7b36b-830e-4517-b9e9-0268192ebc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:44Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4596ab9a-579f-4ef7-874e-7267cb6d859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4596ab9a-579f-4ef7-874e-7267cb6d859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc303699-160b-4f4c-aafe-18424db3ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc303699-160b-4f4c-aafe-18424db3ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a7b36b-830e-4517-b9e9-0268192ebc37', 'volume_name': 'volume-02a7b36b-830e-4517-b9e9-0268192ebc37', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e948710-3099-4d74-897f-56d7d047f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e948710-3099-4d74-897f-56d7d047f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6faa4a-282f-4f75-a6f3-2536ea613ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:44 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Volume 02a7b36b-830e-4517-b9e9-0268192ebc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a7b36b-830e-4517-b9e9-0268192ebc37', 'volume_size': 1} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-212645301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a7b36b-830e-4517-b9e9-0268192ebc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:44Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Creating volume 02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:44 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:44 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 1073741824 Jul 27 13:31:44 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:44 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 1073741824" returned: 0 in 0.433s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:44 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:44 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 Jul 27 13:31:44 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:45 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37" returned: 0 in 0.281s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6faa4a-282f-4f75-a6f3-2536ea613ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a7b36b-830e-4517-b9e9-0268192ebc37', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc48a5ba-3275-4903-9214-c7c246fe1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:45 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Volume volume-02a7b36b-830e-4517-b9e9-0268192ebc37 (02a7b36b-830e-4517-b9e9-0268192ebc37): created successfully Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc48a5ba-3275-4903-9214-c7c246fe1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (c92ca946-59c7-4809-b771-24c9cde86f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:45 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1ee9b7fd-5ee7-46f2-bd3f-73b55481f1e3 tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Creating offline snapshot bc65de1e-c841-4544-8d66-5e76f22111c4 of volume 02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb217a0-9686-4404-ae4f-f316262be2f5]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:45 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 Jul 27 13:31:45 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:45 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37" returned: 0 in 0.370s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:45 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:45 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 1G Jul 27 13:31:45 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:46 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 1G" returned: 0 in 0.502s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a7b36b-830e-4517-b9e9-0268192ebc37 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:46 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a7b36b-830e-4517-b9e9-0268192ebc37 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 Jul 27 13:31:46 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:46 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a7b36b-830e-4517-b9e9-0268192ebc37 -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4" returned: 0 in 0.291s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:46 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 is being set with open permissions: ugo+rw Jul 27 13:31:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:46 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 Jul 27 13:31:46 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:46 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4" returned: 0 in 0.261s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:46 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:47 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info Jul 27 13:31:47 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:47 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info" returned: 0 in 0.258s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:47 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info is being set with open permissions: ugo+rw Jul 27 13:31:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:47 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info Jul 27 13:31:47 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:47 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.info" returned: 0 in 0.241s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:47 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:47 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-161deca5-04bc-4191-9d53-c1cf2f862d1c tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-bc65de1e-c841-4544-8d66-5e76f22111c4-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Lock "cinder-bc65de1e-c841-4544-8d66-5e76f22111c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-02a7b36b-830e-4517-b9e9-0268192ebc37" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-02a7b36b-830e-4517-b9e9-0268192ebc37" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-bc65de1e-c841-4544-8d66-5e76f22111c4" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-bc65de1e-c841-4544-8d66-5e76f22111c4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot bc65de1e-c841-4544-8d66-5e76f22111c4 of volume 02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a1db1f-ed2b-4ce6-b46e-9937383e2826]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:48 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:48 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 Jul 27 13:31:48 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:49 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4" returned: 0 in 0.387s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:49 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a7b36b-830e-4517-b9e9-0268192ebc37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:49 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fdd676-9d7a-4180-9ef5-19234f542328]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:49 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 Jul 27 13:31:49 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:49 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37" returned: 0 in 0.430s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:49 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:49 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 Jul 27 13:31:49 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:50 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4" returned: 0 in 0.368s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:50 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4 Jul 27 13:31:50 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:50 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37.bc65de1e-c841-4544-8d66-5e76f22111c4" returned: 0 in 0.278s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-bc65de1e-c841-4544-8d66-5e76f22111c4" released by "_delete_snapshot" :: held 1.571s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-02a7b36b-830e-4517-b9e9-0268192ebc37" released by "delete_snapshot" :: held 1.604s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Created reservations ['3c14d046-7dc5-4e6a-b1bf-09801cdddff1', '6355ff74-345b-40cb-bb28-5bab3b10fe46', 'ff71233d-d8d5-43d6-8f45-13c4b7392e98', 'ee8dc822-d7cc-42f3-8969-2966b5e696db'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:50 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-94ab2c41-30a8-4d33-b73c-789ce0809236 tempest-ProjectMemberTests-702518941 None] Lock "cinder-bc65de1e-c841-4544-8d66-5e76f22111c4-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-02a7b36b-830e-4517-b9e9-0268192ebc37-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Lock "cinder-02a7b36b-830e-4517-b9e9-0268192ebc37-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-02a7b36b-830e-4517-b9e9-0268192ebc37" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-02a7b36b-830e-4517-b9e9-0268192ebc37" acquired by "delete_volume" :: waited 0.019s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c60d4e-0f91-449b-9ebf-31381c23448a]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:50 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:51 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 Jul 27 13:31:51 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:51 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37" returned: 0 in 0.372s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:51 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37 Jul 27 13:31:51 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:51 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-02a7b36b-830e-4517-b9e9-0268192ebc37" returned: 0 in 0.247s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-02a7b36b-830e-4517-b9e9-0268192ebc37" released by "delete_volume" :: held 0.704s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Created reservations ['4bac0c75-7c1e-4551-a181-87dcf11826d8', '47e38beb-9efe-4de5-8efc-cb7b0f54028b', '7715fdc1-6110-4714-b1bf-f691e7d13972', 'ef57d8c1-c836-442b-81ac-909e055269f4'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:51 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:51 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:51 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.249s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:51 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:52 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-1c80ec9f-cfc2-4ec8-bc1c-0acb740f573f tempest-ProjectMemberTests-702518941 None] Lock "cinder-02a7b36b-830e-4517-b9e9-0268192ebc37-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (6b1a1929-2f48-41b8-8717-c6b8da5efc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c339e751-66dc-41cf-81bb-309789055fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c339e751-66dc-41cf-81bb-309789055fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603275782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a327860-63e6-4db1-832d-a003347c1f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:52Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d190bb-96a9-413b-ae59-a64af23382a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d190bb-96a9-413b-ae59-a64af23382a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fbffce-69fb-48a1-83e3-bc0cbb09cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fbffce-69fb-48a1-83e3-bc0cbb09cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a327860-63e6-4db1-832d-a003347c1f7e', 'volume_name': 'volume-4a327860-63e6-4db1-832d-a003347c1f7e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2230e48-e52e-40ba-97ed-1185005b2246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2230e48-e52e-40ba-97ed-1185005b2246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b85fcf-87ca-4b12-824c-79a065782911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:52 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Volume 4a327860-63e6-4db1-832d-a003347c1f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a327860-63e6-4db1-832d-a003347c1f7e', 'volume_size': 1} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-27T11:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603275782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a327860-63e6-4db1-832d-a003347c1f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505855b03eb04f8b925d90f3c7c7d185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-27T11:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-27T11:31:52Z,use_quota=True,user_id='981c868fab8a4943b8820f03bee3d835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29afaa54-77f9-4a1e-9c11-36d06bade61a),volume_type_id=29afaa54-77f9-4a1e-9c11-36d06bade61a)}" {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Creating volume 4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 as target Quobyte volume. {{(pid=88202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 27 13:31:52 devstack cinder-volume[88202]: INFO cinder.volume.drivers.remotefs [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076 Jul 27 13:31:52 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e 1073741824 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:52 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e 1073741824 Jul 27 13:31:52 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:52 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e 1073741824" returned: 0 in 0.415s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:53 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e Jul 27 13:31:53 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:53 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e" returned: 0 in 0.236s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'} {{(pid=88202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b85fcf-87ca-4b12-824c-79a065782911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a327860-63e6-4db1-832d-a003347c1f7e', 'volume_size': 1}' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c953c51d-9ea8-4179-be9e-9f3cc2a53cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 27 13:31:53 devstack cinder-volume[88202]: INFO cinder.volume.flows.manager.create_volume [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Volume volume-4a327860-63e6-4db1-832d-a003347c1f7e (4a327860-63e6-4db1-832d-a003347c1f7e): created successfully Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c953c51d-9ea8-4179-be9e-9f3cc2a53cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Flow 'volume_create_manager' (6b1a1929-2f48-41b8-8717-c6b8da5efc66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 27 13:31:53 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7cef6857-b6c9-4115-9143-4561801d12df tempest-ProjectMemberTests-702518941 None] Created volume successfully. Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Creating offline snapshot 13e4fe02-5ced-4576-a193-29786786d5a2 of volume 4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab27038-d3e4-438e-aad2-1590918a5d3e]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:53 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:53 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e Jul 27 13:31:53 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:54 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e" returned: 0 in 0.356s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 1G {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:54 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 1G Jul 27 13:31:54 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:54 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 1G" returned: 0 in 0.374s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a327860-63e6-4db1-832d-a003347c1f7e -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:54 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a327860-63e6-4db1-832d-a003347c1f7e -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 Jul 27 13:31:54 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:54 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a327860-63e6-4db1-832d-a003347c1f7e -F qcow2 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2" returned: 0 in 0.289s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:54 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 is being set with open permissions: ugo+rw Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:54 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 Jul 27 13:31:54 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:54 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2" returned: 0 in 0.240s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:54 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:54 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info Jul 27 13:31:54 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:55 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info" returned: 0 in 0.248s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:55 devstack cinder-volume[88202]: WARNING cinder.volume.drivers.remotefs [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info is being set with open permissions: ugo+rw Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:55 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info Jul 27 13:31:55 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:55 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.info" returned: 0 in 0.237s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:55 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-2e75b47a-9fa8-48c7-a12a-fbf477548fc5 tempest-ProjectMemberTests-702518941 None] Create snapshot completed successfully Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-13e4fe02-5ced-4576-a193-29786786d5a2-delete_snapshot" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Lock "cinder-13e4fe02-5ced-4576-a193-29786786d5a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-4a327860-63e6-4db1-832d-a003347c1f7e" by "delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-4a327860-63e6-4db1-832d-a003347c1f7e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-13e4fe02-5ced-4576-a193-29786786d5a2" by "_delete_snapshot" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-13e4fe02-5ced-4576-a193-29786786d5a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Deleting offline snapshot 13e4fe02-5ced-4576-a193-29786786d5a2 of volume 4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] snapshot_file for this snap is: volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 {{(pid=88202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc5559-cb1e-4012-8b1b-290671682254]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:55 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:56 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 Jul 27 13:31:56 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:56 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2" returned: 0 in 0.349s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:56 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.remotefs [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a327860-63e6-4db1-832d-a003347c1f7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 27 13:31:56 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ec92c-5506-44df-b75a-c4d22f99da17]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:56 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e Jul 27 13:31:56 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:56 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e" returned: 0 in 0.351s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:56 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:56 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 Jul 27 13:31:56 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:57 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2" returned: 0 in 0.334s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:57 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2 Jul 27 13:31:57 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:57 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e.13e4fe02-5ced-4576-a193-29786786d5a2" returned: 0 in 0.242s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-13e4fe02-5ced-4576-a193-29786786d5a2" released by "_delete_snapshot" :: held 1.362s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-4a327860-63e6-4db1-832d-a003347c1f7e" released by "delete_snapshot" :: held 1.385s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Created reservations ['b59e41fd-2cf2-4339-8309-fce28c0c7342', '4fb4fe96-2b03-4d9b-945a-dde02da0eee4', '0b6c55b1-1c41-4390-a33a-9dd15e28aef2', '77a26849-e3a5-466b-84d4-6aec55ebd70c'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:57 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Delete snapshot completed successfully. Jul 27 13:31:57 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-fc6c624b-fd75-4aee-aae2-389618eb9a52 tempest-ProjectMemberTests-702518941 None] Lock "cinder-13e4fe02-5ced-4576-a193-29786786d5a2-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-4a327860-63e6-4db1-832d-a003347c1f7e-delete_volume" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Lock "cinder-4a327860-63e6-4db1-832d-a003347c1f7e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Acquiring lock "cinder-quobyte-4a327860-63e6-4db1-832d-a003347c1f7e" by "delete_volume" {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-4a327860-63e6-4db1-832d-a003347c1f7e" acquired by "delete_volume" :: waited 0.015s {{(pid=88202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f975f466-1580-4089-abe4-5f434c473aed]: (4, 'qcow2') {{(pid=88961) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:58 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e Jul 27 13:31:58 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:58 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e" returned: 0 in 0.348s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:58 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e Jul 27 13:31:58 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:58 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39/volume-4a327860-63e6-4db1-832d-a003347c1f7e" returned: 0 in 0.242s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Lock "cinder-quobyte-4a327860-63e6-4db1-832d-a003347c1f7e" released by "delete_volume" :: held 0.644s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.quota [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Created reservations ['1036aef6-fa07-477f-80b0-e18bbd09b048', '1b126b02-833b-404f-8aea-305ba4e6257f', 'c2656000-9e9d-45a2-b11d-6d08c18bd0ab', '932e55f9-1813-4440-ac72-bc6a0e3d22ac'] {{(pid=88202) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076': None} {{(pid=88202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG cinder.volume.drivers.quobyte [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a1ec349-106b-4260-903d-824218111076'] {{(pid=88202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.lockutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 27 13:31:58 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 27 13:31:58 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39 Jul 27 13:31:58 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 27 13:31:59 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 27 13:31:59 devstack cinder-volume[88202]: DEBUG oslo_concurrency.processutils [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/64c04635ed5c4e065c708917f4450b39" returned: 0 in 0.239s {{(pid=88202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 27 13:31:59 devstack cinder-volume[88202]: DEBUG cinder.manager [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Notifying Schedulers of capabilities ... {{(pid=88202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 27 13:31:59 devstack cinder-volume[88202]: INFO cinder.volume.manager [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Deleted volume successfully. Jul 27 13:31:59 devstack cinder-volume[88202]: DEBUG cinder.coordination [None req-7784c9e6-d0d1-45f0-a354-2f92cb0df82f tempest-ProjectMemberTests-702518941 None] Lock "cinder-4a327860-63e6-4db1-832d-a003347c1f7e-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=88202) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 27 13:32:08 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:UPDATE=98,cinder:INSERT=21,cinder:DELETE=9,cinder:SELECT=87 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 27 13:32:09 devstack cinder-volume[88202]: DEBUG dbcounter [-] [88202] Writing DB stats cinder:SELECT=71,cinder:UPDATE=101,cinder:DELETE=8,cinder:INSERT=33 {{(pid=88202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}